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Background of the Invention 
Technical Field 

This application relates to estimating flight data, and more particularly to 
1 5 estimating the weight of an aircraft. 

Description of Related Art 

Flight parameters, and estimates thereof, may be used in connection with a variety 
of different applications. One such application is related to aircraft parts. Systems exist 
that may be used in assessing the health of aircraft parts as well as detection and 
20 prediction of part failure. Such systems may use a variety of different inputs, including 
flight parameters, in making determinations and predictions in connection with the 
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aircraft parts. In order to produce accurate and reliable results, the systems may rely on 
the accuracy of the inputs. Inputs may include, for example, the gross weight of the 
aircraft. 

5 In connection with the aircraft gross weight, existing systems and techniques may 

use data gathered from sensors as well as crew entered values, such as weights of the 
cargo and passenger(s). It may also not be possible for the crew to enter these values 
given particular flight conditions. Such human entered values introduce a possibility of 
human error. Additionally, this human error may be difficult to quantify or bound. 

10 

Thus, it may be desirable to provide for an efficient technique for determining the 
gross weight of an aircraft. It may be desirable that this technique provide an estimation 
of the gross aircraft weight in a deterministic and automatic fashion while minimizing the 
amount of human error. 

15 



2 
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Summary of the Invention 

In accordance with one aspect of the invention is a method for determining a 
weight of an aircraft comprising: determining a flight regime in accordance with one or 
5 more inputs; selecting a neural net in accordance with said flight regime; and determining 
said weight using said neural net. The neural net may be trained offline prior to 
determining said weight of said aircraft. The step of determining said weight of said 
aircraft may be performed during operation of said aircraft. The neural net may be one of 
a plurality of neural nets. The neural net may be a feedforward neural net. The neural net 

1 0 may include a single hidden layer. The neural net may have a same set of 

interconnections between each neuron in said hidden layer and an input layer, and a same 
set of interconnection between said each neuron and an output layer. Each of said 
neurons in said hidden layer may utilize a same sigmoidal activation function. The 
neural net may include between 20 and 35 neurons in said hidden layer. The weight may 

15 be used as an input to another process. The flight regime may be one of a plurality of 
flight regimes that are mutually exclusive from one another. The flight regime may be 
manually selected. The flight regime may be an effective flight regime including one or 
more actual flight regimes using the same set of one or more neural nets. One or more 
neural net inputs may be used as inputs to said neural net selected, and the one or more 

20 neural net inputs may include at least one derived parameter that is determined based on 
mathematical and physical relationships of measured data. The one or more neural net 
inputs may be a first number of derived parameters determined using a second number of 
raw data values, the second number being greater than said first number. One or more 
neural net inputs may include at least one of the following: 

3 
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Corrected Vertical Acceleration (cN z ) represented as: 



cN=\ + N- 



1 



cos 



Where 



Nz is Vertical Acceleration; 
0 is Roll Attitude; 



1 0 Torque Coefficient (Cq) represented as: 

Q 412.0/100.0* (Eng\Q+Eng2Q)/ 2.0 



Cq = 



pA(QR) 0023769 * a *„ R i H 2*x* — * ^1^- * Rf 

100 60 
Where Q is total torque (RPM); 

p is density (lb-sec 2 /ft 4 ); 
A is the area of the main rotor disc (ft 2 ); 
15 Q is the rotation speed of the rotor (rad/s); 

R is the radius of the main rotor disc (ft); 
Nr is the main rotor speed (%); 
a is the density ratio; 

20 

Advance Ratio (u) is represented as: 
V KIAS* 1.6890 

M= QR- 2 * z .Nrt 257.887 
100 60 

Where KIAS is indicated airspeed in knots; 

25 Climb rate over tip speed (Ut) is represented as: 
= V c = ROC/ 60 
Mc ~QR~ nt ,iVr, 257.887 

100 60 
Where ROC is rate of climb (ft/min); 



30 Density Ratio (a) is represented as: 

a = 0.0023769 * ( ) * (1 - (0.0019812 * — ^—)) 5 256 

OAT + 273A5 288.15 

Where OAT is outside air temperature (°C); 
Hp is Barometric Altitude (ft). 

35 
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The neural net inputs may include roll attitude and pitch attitude in accordance with the 
selected flight regime. One of said neural net inputs may be a derived parameter based 
on at least one of roll attitude and pitch attitude in accordance with the selected flight 
5 regime. The neural net may be included in a gross weight processor. The gross weight 
processor may be included on the aircraft for which said weight is determined. The gross 
weight processor may be included at a ground location and communicates with said 
aircraft. The one or more inputs may include at least one of: a sensor measurement, 
manual input, data from a storage location. The method may further comprise: 

1 0 determining said flight regime as a hover flight regime in accordance with the following 
input parameters: landing flag, takeoff flag, weight on wheels, yaw rate, rate of climb, 
pitch attitude, roll attitude, drift velocity, ground speed, airspeed, and control reversal 
flag, wherein said landing flag indicates whether said aircraft is landing, said takeoff flag 
indicates whether said aircraft is in takeoff mode, and said control reversal flag indicates 

1 5 whether said aircraft is in a reversal mode. The landing flag may indicate no landing, said 
takeoff flag may indicate no takeoff, said weight on wheels may indicate no weight on 
wheels, said control reversal flag may indicate that said aircraft is not in reversal mode, 
said yaw rate may have an approximate value within the inclusive range of: -2.5 < yaw 
rate 2.5 degrees/second, said pitch attitude is approximately 10 degrees, said rate of climb 

20 may be approximately within the inclusive range of: -200 < rate of climb < 200 

feet/minute, said roll attitude may approximate a value within the inclusive range of: -6 
< roll attitude < 3 degrees, said drift velocity may approximate a value within the 
inclusive range of: -7 < drift velocity < 7 knots, said ground speed may approximate a 

5 
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value within the inclusive range of: -7 < ground speed < 7 knots, said airspeed may be 
an approximate value less than or equal to 38 knots. The method may also include: 
determining that said aircraft is in a hover flight regime at a first point in time; and 
determining that said aircraft remains in said hover flight regime at a second later point in 
5 time if said airspeed at said second later point in time does not exceed 43 knots. 

The method may also include: determining said flight regime as a forward flight regime 
in accordance with the following input parameters: landing flag, takeoff flag, weight on 
wheels, yaw rate, rate of climb, pitch attitude, roll attitude, airspeed, control reversal flag, 
and sideslip, wherein said landing flag indicates whether said aircraft is landing, said 

1 0 takeoff flag indicates whether said aircraft is in takeoff mode, and said control reversal 
flag indicates whether said aircraft is in a reversal mode. The landing flag may indicate 
no landing, said takeoff flag may indicate no takeoff, said weight on wheels may indicate 
no weight on wheels, said control reversal flag may indicate that said aircraft is not in 
reversal mode, said yaw rate may have an approximate value within the inclusive range 

1 5 of: -5 < yaw rate <5 degrees/second, said pitch attitude may be within the inclusive range 
of: -10 < pitch attitude< 10 degrees, said rate of climb may be approximately within the 
inclusive range of: -500 < rate of climb < 500 feet/minute, said roll attitude may 
approximate a value within the inclusive range of: -10 < roll attitude < 10 degrees, said 
side slip may approximate a value within the inclusive range of: -0.05 < side slip < 0, 

20 said airspeed may be an approximate value greater than 38 knots. The method may also 
include determining that said aircraft is in a forward flight regime at a first point in time; 
and determining that said aircraft remains in said forward flight regime at a second later 
point in time if said airspeed at said second later point in time is greater than 33 knots. 

6 
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The method may include determining said flight regime as a turn flight regime in 
accordance with the following input parameters: landing flag, takeoff flag, weight on 
wheels, roll attitude, airspeed, and rate of climb, wherein said landing flag indicates 
whether said aircraft is landing and said takeoff flag indicates whether said aircraft is in 
takeoff mode. The landing flag may indicate no landing, said takeoff flag may indicate 
no takeoff, said weight on wheels may indicate no weight on wheels, said rate of climb 
may be approximately within the inclusive range of: -500 < rate of climb < 500 
feet/minute, said roll attitude may approximate a value within the inclusive range of: - 
10 < roll attitude < 10 degrees, said airspeed may be an approximate value greater than 
38 knots. The method may include: determining that said aircraft is in a turn flight 
regime at a first point in time; and determining that said aircraft remains in said turn 
flight regime at a second later point in time unless at least one of the following is true: 
roll attitude is outside of the range -7,+13, and said airspeed is less than 36. One or more 
inputs may be scaled within a predetermined range. The method may include 
determining a sensitivity of said weight with respect to a parameter used in determining 
said weight. The sensitivity of said weight with respect to said parameter may 
determined in accordance with a partial derivative of said weight with respect to said 
parameter. The weight may be determined using a neural network and represented as: 



where z is a vector of inputs, p is a number of neurons in the hidden layer, m is a number 
of inputs, Wljj is a weight of the j* input to the i* neuron in the hidden layer, blj is a 
bias added to the I th neuron, W2j is a weight of the i* neuron to the output neuron, b2 is a 




J 
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bias added to an output neuron, and y is the tanh function. The neural network may be a 
feedforward neural net with one hidden layer containing p sigmoidal neurons, and the 
sensitivity is represented as: 

6W g (z)/5z k = 



b2 + f d fV2 i *rib\ l +f i W\ u *z J ^ 



i=\ 



* " 



r \ 



7=1 



where y x is cosh' 2 . The sensitivity with respect to an input vector z having said 
parameter that is a kth parameter, z k , may be determined as a partial derivative of said 
weight with respect to the kth parameter evaluated in accordance with the input vector. 

10 

In accordance with another aspect of the invention is a method of determining a 
weight of an aircraft comprising:receiving one or more values; and determining said 
weight using a Kalman filter wherein said one or more values are used as inputs to said 
Kalman filter. One or more measurements may be input to said Kalman filter, and the 

1 5 method may include: determining a flight regime in accordance with one or more regime 
measurements; selecting a function based on said flight regime; and determining a 
covariance associated with one of said measurements in accordance with said function. 
The flight regime may be the hover flight regime, and said function may determine said 
covariance associated with a weight estimate. The function may determine the covariance 

20 in accordance with body accelerations of said aircraft along x and z axes, roll attitude, 
pitch attitude, airspeed and altitude. One or more measurements may be input to said 
Kalman filter, said one or more measurements including at least one of: a weight 
estimate, and engine fuel flow rate. The weight estimate may be a predetermined value 

8 
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based on vehicle flight and performance data. The weight estimate may be based on 
manually entered data representing a sum gross weight of said aircraft. The flight regime 
may be manually determined. The flight regime may be determined in accordance with a 
predetermined mapping that maps one or more values to a particular flight regime, 
5 wherein a given set of one or more inputs values uniquely maps to a flight regime. The 
Kalman filter may produce an output used as an input to another component. 

In accordance with another aspect of the invention is a system for determining a 
weight of an aircraft comprising: a regime recognizer that determines a regime indicator 

10 in accordance with a portion of said one or more inputs; and a gross weight estimator that 
determines said weight of said aircraft, said gross weight estimator including at least one 
of: a Kalman filter, and one or more neural nets, and using at least one of said Kalman 
filter and a first of said one or more neural nets in determining said weight. The system 
may further comprise: an input processor that processes one or more inputs producing 

1 5 one or more processed inputs, said one or more inputs including at least one sensor 
measurement; and a portion of said one or more processed inputs are neural net inputs 
used by said one or more neural nets, and said gross weight estimator including: 
a neural net selector that selects a neural net in accordance with said regime indicator. 
The regime recognizer may be included in said input processor. The gross weight 

20 estimator may include one or more neural nets whose output, when said one or more 

neural nets is selected in accordance with said flight regime indicator, is an input to said 
Kalman filter. 

9 
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In accordance with another aspect of the invention is a method for determining an 
aircraft parameter comprising: determining a flight regime in accordance with one or 
more inputs; selecting a neural net in accordance with said flight regime; and 
determining said aircraft parameter using said neural net. The neural net may use at least 
5 one derived parameter determined from a relationship between one or more raw input 
values. 

In accordance with yet another aspect of the invention is a method of determining 
an aircraft parameter comprising: receiving one or more values; and determining said 
10 aircraft parameter using a Kalman filter wherein said one or more values are used as 
inputs to said Kalman filter. The method may include determining a flight regime in 
accordance with one or more regime measurements; selecting a function based on said 
flight regime; and determining a covariance associated with one of said measurements in 
accordance with said function. 

15 

In accordance with another aspect of the invention is a system for determining an 
aircraft parameter comprising: a regime recognizer that determines a regime indicator in 
accordance with a portion of said one or more inputs; and an aircraft parameter generator 
that determines said aircraft parameter, said aircraft parameter generator including at least 
20 one of: a Kalman filter, and one or more neural nets, and using at least one of said 
Kalman filter and a first of said one or more neural nets in determining said aircraft 
parameter. 

10 
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In accordance with another aspect of the invention is a computer program product 
for determine a weight of an aircraft comprising code that: determines a flight regime in 
accordance with one or more inputs; selects a neural net in accordance with said flight 
regime; and determines said weight using said neural net. The neural net may be trained 
5 offline prior to determining said weight of said aircraft. The code that determines said 
weight of said aircraft is executed during operation of said aircraft. The neural net may 
be one of a plurality of neural nets. The neural net may be a feedforward neural net. 
The neural net may include a single hidden layer. The neural net may have a same set of 
interconnections between each neuron in said hidden layer and an input layer, and a same 

1 0 set of interconnection between said each neuron and an output layer. Each of the neurons 
in said hidden layer may utilize a same sigmoidal activation function. The neural net 
may include between 20 and 35 neurons in said hidden layer. The weight may be used as 
an input to another process. The flight regime may be one of a plurality of flight regimes 
that are mutually exclusive from one another. The flight regime may be manually 

1 5 selected. The flight regime may be an effective flight regime including one or more 

actual flight regimes using the same set of one or more neural nets. One or more neural 
net inputs may be used as inputs to said neural net selected, and the one or more neural 
net inputs may include at least one derived parameter that is determined based on 
mathematical and physical relationships of measured data. The one or more neural net 

20 inputs may be a first number of derived parameters determined using a second number of 
raw data values, the second number being greater than said first number. One or more 
neural net inputs may include at least one of the following: 

Corrected Vertical Acceleration (cN z ) represented as: 

11 
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5 



25 



cN z =\ + N z - 
Where 



' 1 



v cos 



Nz is Vertical Acceleration; 
0 is Roll Attitude; 



Torque Coefficient (Cq) represented as: 

Q _ * 412.0/100.0 *(EnglQ+Eng2Q)/ 2.0 



p^) 2 .0023769*^ *(2*^*^^**) 2 

100 60 



Where Q is total torque (RPM); 
10 p is density (lb-sec 2 /ft 4 ); 

A is the area of the main rotor disc (ft 2 ); 

Q is the rotation speed of the rotor (rad/s); 

R is the radius of the main rotor disc (ft); 

Nr is the main rotor speed (%); 
15 a is the density ratio; 



Advance Ratio (u) is represented as: 
V KIAS* 1.6890 

M = nR~ 2 *^Nr , 257.887 
100 60 

20 Where KIAS is indicated airspeed in knots; 

Climb rate over tip speed (u«) is represented as: 
V c ROC 1 60 



QR 2 t Nr „ 257.887 

100 60 
Where ROC is rate of climb (ft/min); 



Density Ratio (a) is represented as: 

o = 0.0023769 * ( ) * (1 - (0.0019812 * — ^-)) 5 256 

OAT + 273.15 288.15 

30 Where OAT is outside air temperature (°C); 

Hp is Barometric Altitude (ft). 



12 
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The neural net inputs may include roll attitude and pitch attitude in accordance with the 
selected flight regime. One of said neural net inputs may be a derived parameter based 
on at least one of roll attitude and pitch attitude in accordance with the selected flight 
regime. The neural net may be included in a gross weight processor. 
5 The gross weight processor may be included on the aircraft for which said weight is 
determined. The gross weight processor may be included at a ground location and 
communicates with said aircraft. The one or more inputs may include at least one of: a 
sensor measurement, manual input, data from a storage location. The computer program 
product may also include code that: determines said flight regime as a hover flight regime 

10 in accordance with the following input parameters: landing flag, takeoff flag, weight on 
wheels, yaw rate, rate of climb, pitch attitude, roll attitude, drift velocity, ground speed, 
airspeed, and control reversal flag, wherein said landing flag indicates whether said 
aircraft is landing, said takeoff flag indicates whether said aircraft is in takeoff mode, and 
said control reversal flag indicates whether said aircraft is in a reversal mode. The 

1 5 landing flag may indicate no landing, said takeoff flag may indicate no takeoff, said 
weight on wheels may indicate no weight on wheels, said control reversal flag may 
indicate that said aircraft is not in reversal mode, said yaw rate may have an approximate 
value within the inclusive range of: -2.5 < yaw rate 2.5 degrees/second, said pitch attitude 
may be approximately 10 degrees, said rate of climb may be approximately within the 

20 inclusive range of: -200 < rate of climb < 200 feet/minute, said roll attitude may 

approximate a value within the inclusive range of: -6 < roll attitude < 3 degrees, said 
drift velocity may approximate a value within the inclusive range of: -7 < drift velocity 
< 7 knots, said ground speed may approximate a value within the inclusive range of: -7 

13 
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< ground speed < 7 knots, said airspeed may be an approximate value less than or equal 
to 38 knots. The computer program product may further comprises code that: determines 
said aircraft is in a hover flight regime at' a first point in time; and determines said aircraft 
remains in said hover flight regime at a second later point in time if said airspeed at said 
5 second later point in time does not exceed 43 knots. The computer program product may 
also include: code that determines said flight regime as a forward flight regime in 
accordance with the following input parameters: landing flag, takeoff flag, weight on 
wheels, yaw rate, rate of climb, pitch attitude, roll attitude, airspeed, control reversal flag, 
and sideslip, wherein said landing flag indicates whether said aircraft is landing, said 

1 0 takeoff flag indicates whether said aircraft is in takeoff mode, and said control reversal 
flag indicates whether said aircraft is in a reversal mode. The landing flag may indicate 
no landing, said takeoff flag may indicate no takeoff, said weight on wheels may indicate 
no weight on wheels, said control reversal flag may indicate that said aircraft is not in 
reversal mode, said yaw rate may have an approximate value within the inclusive range 

1 5 of: -5 < yaw rate <5 degrees/second, said pitch attitude may be within the inclusive range 
of: -10 < pitch attitude< 10 degrees, said rate of climb may be approximately within the 
inclusive range of: -500 < rate of climb < 500 feet/minute, said roll attitude approximates 
a value within the inclusive range of: -10 < roll attitude < 10 degrees, said side slip may 
approximate a value within the inclusive range of: -0.05 < side slip < 0, said airspeed 

20 may be an approximate value greater than 38 knots. The computer program product may 
further comprise code that: determines said aircraft is in a forward flight regime at a first 
point in time; and determines said aircraft remains in said forward flight regime at a 
second later point in time if said airspeed at said second later point in time is greater than 

14 
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10 



15 



33 knots. The computer program product may also include code that: determines said 
flight regime as a turn flight regime in accordance with the following input parameters: 
landing flag, takeoff flag, weight on wheels, roll attitude, airspeed, and rate of climb, 
wherein said landing flag indicates whether said aircraft is landing and said takeoff flag 
indicates whether said aircraft is in takeoff mode. The landing flag may indicate no 
landing, said takeoff flag may indicate no takeoff, said weight on wheels may indicate no 
weight on wheels, said rate of climb may be approximately within the inclusive range of: 
-500 < rate of climb < 500 feet/minute, said roll attitude may approximate a value within 
the inclusive range of: -10 < roll attitude < 10 degrees, said airspeed may be an 
approximate value greater than 38 knots. The computer program product may also 
include code that: determines said aircraft is in a turn flight regime at a first point in time; 
and determines said aircraft remains in said turn flight regime at a second later point in 
time unless at least one of the following is true: roll attitude is outside of the range - 
7,+13, and said airspeed is less than 36. One or more inputs may be scaled within a 
predetermined range. The computer program product may also include code that: 
determines a sensitivity of said weight with respect to a parameter used in determining 
said weight. The sensitivity of said weight with respect to said parameter may be 
determined in accordance with a partial derivative of said weight with respect to said 
parameter. The weight may be determined using a neural network and represented as: 



where z is a vector of inputs, p is a number of neurons in the hidden layer, m is a number 
of inputs, Wig is a weight of the j th input to the i 1 * 1 neuron in the hidden layer, blj is a 
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bias added to the i th neuron, W2i is a weight of the i th neuron to the output neuron, b2 is a 
bias added to an output neuron, and y is the tanh function. The neural network may be a 
feedforward neural net with one hidden layer containing p sigmoidal neurons, and the 
sensitivity is represented as: 

5W g (z)/5z k = 



r 



p ( \ 



P ( m \ 

w v y-i J 



where f is cosh" 2 . 

The sensitivity with respect to an input vector z having said parameter that is a kth 
10 parameter, Zk , may be determined as a partial derivative of said weight with respect to 
the kth parameter evaluated in accordance with the input vector. 

In accordance with another aspect of the invention is a computer program product 
that determines a weight of an aircraft comprising code that: receives one or more values; 

1 5 and determines said weight using a Kalman filter wherein said one or more values are 
used as inputs to said Kalman filter. One or more measurements may be input to said 
Kalman filter, and the computer program product may further comprise code that: 
determines a flight regime in accordance with one or more regime measurements; selects 
a function based on said flight regime; and determines a covariance associated with one 

20 of said measurements in accordance with said function. The flight regime may be the 
hover flight regime, and said function may determine said covariance associated with a 
weight estimate. The function may determine said covariance in accordance with body 
accelerations of said aircraft along x and z axes, roll attitude, pitch attitude, airspeed and 

16 
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altitude. One or more measurements may be input to said Kalman filter, said one or more 
measurements including at least one of: a weight estimate, and engine fuel flow rate. 
The weight estimate may be a predetermined value based on vehicle flight and 
performance data. The weight estimate may be based on manually entered data 
5 representing a sum gross weight of said aircraft. The flight regime is manually 

determined. The flight regime may be determined in accordance with a predetermined 
mapping that maps one or more values to a particular flight regime, wherein a given set 
of one or more inputs values uniquely maps to a flight regime. The Kalman filter 
produces an output used as an input to another component. 

10 

In accordance with another aspect is a computer program product for determining 
an aircraft parameter comprising code that: determines a flight regime in accordance with 
one or more inputs; selects a neural net in accordance with said flight regime; and 
determines said aircraft parameter using said neural net. The neural net may use at least 
1 5 one derived parameter determined from a relationship between one or more raw input 
values. 

In accordance with another aspect of the invention is a computer program 
product that determines an aircraft parameter comprising code that: receives one or more 
20 values; and determines said aircraft parameter using a Kalman filter wherein said one or 
more values are used as inputs to said Kalman filter. The computer program product may 
also include code that determines a flight regime in accordance with one or more regime 

17 
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measurements; selects a function based on said flight regime; and determines a 
covariance associated with one of said measurements in accordance with said function. 
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Brief Description of Drawings 

Features and advantages of the present invention will become more apparent from 
the following detailed description of exemplary embodiments thereof taken in 
conjunction with the accompanying drawings in which: 

Figures 1 -2 are steps of a flowchart of one method for performing interpolation. 

Figure 3 is an example of an embodiment of a computer system in which the 
method steps of Figures 1-2 may be performed. 

Figures 4-7 are graphical representations in connection with an example in which 
the method steps of Figures 1-2 are performed. 

Figure 8 is a graphical representation of a selected simplex for a point when the 
Delaunay technique is performed for the same point of interest as selected in the example 
of Figures 4-7. 

Figure 9 is an example of a embodiment of a system that may be used in operation 
of an aircraft. 

Figure 10 is a more detailed description of one embodiment of the input processor 
included in the system of Figure 9. 
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Figure 1 1 is a more detailed description of one embodiment of gross weight 
estimator included in the system of Figure 9. 

Figure 12 is an example of one embodiment of a neural net that may be included 
in the gross weight estimator of Figure 1 1 . 

Figure 13 is a flowchart of processing steps of one embodiment used in training, 
verification, and selecting one or more neural nets included in the gross weight estimator 
of Figure 11. 

Figures 14-16 are examples of embodiments of effective regimes that may be 
included in an embodiment. 

Figure 17 is an example illustration of actual regimes that may be included in a 
single effective hover regime in one embodiment. 

Figures 18-27 are examples of actual regimes that may be included in a single 
effective fast forward regime in one embodiment. 

Figures 28-29 are examples of actual regimes that may be included in a single 
effective turn regime in one embodiment. 

Figure 30 is an example graphical illustration of sample results of the testing error 
distribution with neural nets. 
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Figures 31-32 are example graphical illustrations of sample results of the Kalman 
filter performance. 

Figure 33 is a flowchart of processing steps of one embodiment for estimating the 
gross weight of an aircraft using a Kalman filter. 
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DESCRIPTION OF EMBODIMENTS 

Neural networks may be used to model various conditions, such as those 
described herein in connection with estimation of aircraft weight as well as a wide variety 
of other conditions. Part of effectively utilizing a neural network includes properly 
5 training the neural network using a good set of training data. It may be desirable to have 
the training data cover an entire range of expected inputs. However, it may not be 
possible to generate such data sets. In practice, it may be the case that only sparse 
experimental data is available making it difficult to properly train and verify the neural 
network. The sparse experimental data may not cover the desired range of input 

1 0 conditions. Interpolation techniques may be used to generate additional data. However, 
the particular interpolation techniques available for use may be dependent on the 
characteristics of the actual experimental data from which additional data is generated. 
For example, the experimental data may be characterized as not uniform and scattered 
limiting the use of certain interpolation techniques that may be better suited for use with 

1 5 more uniform data. The available interpolation techniques may be further limited by the 
data dimensionality of the model since particular interpolation techniques may not be 
practically used with data dimensions as described elsewhere herein in more detail. 

A majority of interpolation methods may be characterized as primarily suited for 
20 use with data points arranged in a regular rectangular grid, or data that may be 

characterized as generally uniform and regularly structured. That is, for example, 
suppose that each data point consists of an ^-dimensional vector x and a scalar y. For the 
Mh coordinate of a vector x, the measurements available for each of /w/ discrete values 
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are: */(l), x,{2),... 5 x, (n t -1), jc, (/w,). Then, measurement or experimental data is also 
available for each combination of all discrete values x(kj, k2,..., k n ) = [*i(k|), x 2 fe),..., x n 
(k„)] making the total number of available measurements in the experimental data equal 
to the product of numbers m,. For example, if the data were two-dimensional (n = 2), for 
5 uniform data sets there are m f distinct values for the first coordinate of x, m 2 distinct 
values for the second coordinate of x, a total number of data points represented as m = 
m\m 2 , and all measurement values may be arranged into a two-dimensional array y(ij\ 
with / =1,..., m\ J =1,..., m 2 . Similarly, if the data were three-dimensional («=3), for 
uniform data sets there are m\ distinct values for the first coordinate of x, m 2 distinct 

10 values for the second coordinate of x, distinct values for the third coordinate of x ? a 
total number of data points represented as m = m\m 2 m^ and all measurement values may 
be arranged into a three-dimensional array y(i,j, k), with i=\ 9 ... 9 m\ 9 j= 1,..., W2, £=1,..., 
W3. More generally, for an ^-dimensional case, there are m = m\mi...m\ measurement 
values arranged into an ^-dimensional array y(j\, j2,—,jn), with y, = l,...,m,. Interpolation 

1 5 techniques may be used to estimate a value of the function for some intermediate value of 
x within the bounds given by limits Xj(l) and x,(w/), for example, assuming that the 
discrete values for each coordinate of x are increasing. 

Different existing techniques used for interpolation of data described as above 
20 that may be characterized as regularly structured data include, for example, the multi- 
linear method, cubic method, and cubic spline method. Such methods are based on 
finding a hyper-rectangular cell of the grid containing the point x and then fitting a local 
approximating function whose values at the cell vertices are given by tabulated values of 
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y. It should be noted that the size of an ^-dimensional data table may grow quickly with 
respect to n, which may limit applicability of these interpolation approaches. Moreover, 
the use of these particular interpolation approaches may be better suited for use with 
regular or uniform experimental data set generation. 

5 

It may be desirable to use interpolation techniques over data, as described above, 
that does not display a regular, uniform or rectangular structure as may be the case when 
utilizing experimental data. For example, assume that variables x may be measured but 
cannot be set to arbitrary values. Let the collected data set consist of m pairs (x(£), y(k)), 

10 k =1,..., m, such that the particular coordinate values x t (k) need not be the same for any 
two measurement points. Interpolation of scattered data may be more difficult in that 
certain interpolation techniques may not be suitable for use with such data. For example, 
one embodiment of a software product called Matlab provides only two such methods 
within its griddatan function for use with such non-uniform scattered data. These two 

1 5 such methods are known as the nearest neighbor interpolation and linear interpolation 
based on Delaunay tessellation. 

Advantages of the nearest neighbor approach are its speed and modest memory 
requirements and it scales quite easily to higher data dimensions. However, the nearest 
20 neighbor method may generate data points that are not sufficiently accurate and may 
result in a piecewise-constant interpolated function that is discontinuous along lines 
equidistant from two nearest neighboring points. Therefore applicability of nearest 
neighbor interpolation may be limited to instances in which collected data is relatively 
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dense to limit the size of any discontinuity. Additionally, the nearest neighbor technique 
is sensitive with respect to scaling of the coordinates of x such that two different nearest 
neighbors may be generated for a same data point x in instances each having different 
scaling. 

5 

Linear interpolation on Delaunay simplices results in an interpolation function 
that is everywhere continuous. The method is based on tessellation of the data set into 
disjoint simplices (^-dimensional polyhedra with h+1 vertices) such that a hypersphere 
circumscribed on vertices of any one simplex does not contain any other data point. Such 

1 0 tessellation is unique. Within each simplex, a linear function is fit such that its values at 
vertices are equal to the corresponding measurement values. In other words, linear 
functions fitted within neighboring simplices coincide on their boundaries, thus resulting 
in the overall surface being continuous. Therefore, the Delaunay-based technique may be 
used if accuracy and consistency of generated interpolation data are concerns. However, 

15 a limitation of the Delaunay technique is that the values at which the function is 

interpolated must fall within the convex hull of all the available data points. If it does 
not, an alternate interpolation technique, such as the nearest neighbor, may be used for 
nearest neighbor interpolation outside of the convex hull. 

20 Another drawback with the Delaunay technique is the marked increase in growth 

of the computational and storage requirements as the data dimensionality n increases. 
For example, the available implementations of Delaunay tessellation may not be 
practical for «>10. The inventor determined that using the Delaunay technique with a 
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Matlab implementation on a personal computer with 4 GB of RAM was adequate storage 
for values of n<9, and additionally, limiting the data set size. For example, for n=6, 
approximately 2500 data points may be used, and for n=8, approximately 250 data points 
may be used. Such data storage requirements may not be well suited for use with higher 
5 values of n with the Delaunay technique. A user of Matlab may, for example, use a less 
accurate nearest neighbor interpolation technique with larger data dimensionality and 
larger data sets. Additionally, because of the combinatorial nature of the tesselation 
problem, the computation complexity increases rapidly with the dimension of the data set 
size making data sets with larger dimensions, such as more than n=l 1 or n=12, 
1 0 nonscalable for use with existing computer systems. 

What will now be described are techniques that may be used in generating data 
sets based on existing data that may be characterized as non-uniform and scattered in 
which the generated data is more accurate than that of the nearest neighbor technique, 
1 5 and the storage and computational costs are more scalable than those of the Delaunay 
technique as the data dimensionality increases. 

Described in following paragraphs are techniques in which some advantages of 
the Delaunay tessellation-based method are retained while simultaneously relaxing 
20 excessive computational requirements. As described elsewhere herein, one advantage of 
the Delaunay tessellation-based interpolation method over the nearest neighbor method 
is that the Delaunay tessellation-based utilizes information about the local trends 
contained in the data points that surround the point of interest. In contrast, this 
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information is not utilized within the nearest neighbor method, which uses only one - a 
single value at the nearest data point. The technique described in following paragraphs 
utilizes this advantage such that described is an interpolation technique in which the 
interpolated value calculated is based on linear interpolation between the data points 
5 surrounding the point of interest. That is, a simplex is determined from selected data 
points such that the point of interest lies within the interior of the simplex. 

The following interpolation technique also relaxes the strict requirement that the 
surface of the overall interpolated function must be continuous, as in the case of the 

1 0 Delaunay tessellation. The following interpolation technique may select any simplex 
such that the point of interest x lies within its interior and is close to its vertices. Such 
simplices may be formed using n+K nearest neighbors of the point of interest. K may be 
characterized as a parameter selected to limit the number of candidates or points 
considered herein, K>1. The particular value for K used may vary in accordance with the 

1 5 particular considerations of each embodiment. Among those nearest neighbors, different 
sets of H+l points may be used to form candidate simplices. Then a first simplex such 
that the given point x lies within its interior may be selected to perform linear 
interpolation. Determining if x lies within a simplex's interior may be performed by 
expressing x as a linear combination of n vertices of the simplex if the origin of the 

20 coordinate system is translated to the remaining n+l th vertex. If this linear combination is 
convex such that all coefficients are positive and summing to less then 1, then the point 
lies within the vertices forming the selected simplex. 
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Referring now to Figures 1 and 2, shown is a flowchart of steps of an embodiment 
for performing interpolation. At step 12, a set of experimental data points and 
corresponding scalar values representing values of the unknown function relating the data 
points are obtained. This may be represented as a set of data points (x(£), y{k)) k =l,...,m 
5 where \(k) are ^-dimensional vectors, andX^) are the scalars representing values of the 
unknown function at points x(k). At step 14, a first data point x(k) is selected from the 
set of experimental data points, and a point x is selected as the interpolation point and 
represents the point at which an interpolated function value y is approximated. At step 
16, a determination is made as to whether all data points x(k) in the experimental data set 
10 have been processed. If not, control proceeds to step 26 where a distance d k between x 
and every x(k) is determined as: 

dk = \\x-x(k)\\ 

Control proceeds to step 28 where the next data point in the experimental data set is 
obtained. Control then proceeds to decision point 16. 

15 

If at step 16 it is determined that all data points in the experimental data set have 
been processed, control proceeds to step 18 where the distances are sorted to determine 
the n+K lowest values, and the corresponding n+K nearest neighbors of x among all the 
data points x(£). These n+K nearest neighbors may be denoted as z(/), / =1,..., n + K , 
20 with z(l) being the closest to 3c , z(2) the second closest, and so on. 

Control proceeds to step 22 which is the top of a loop for processing each simplex 
formed by a combination of n+1 data points of the n+K nearest neighbors. This loop is 
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performed for all combinations of n+1 data points of the n+K nearest neighbors. At step 
22, the first combination of n+1 data points forming the first simplex are selected. The 
particular set of vertices of this selected simplex for which the current loop iteration at 
step 22 is performed is denoted as v(/) 5 / = 1 . n + 1 . Control proceeds to step 24 
where the origin of the coordinate system of the simplex is shifted such that the first 
vertex, v(l) is the origin. This is performed by defining for each vertex 2 n+1 a shifted 
vertex denoted as: 

vO) = v(y)-v(l) and 
defining for the point of interest: 

x = x - v(l) 

Control proceeds to step 30 where an n x n matrix A is formed from the shifted 
vertices. The matrix A may be represented as a series of column vectors where each 
column vector is one of the shifted vertices as: 

^ = [v(2) 5 v(3) ? ... ? v(« + l)] 

At step 32, the following linear equation is solved for the unknown vector a: 
Aa= x 

where x and A are as defined above. Any one of a variety of different techniques may be 
used to solve the foregoing linear equation, such as Gaussian elimination, factorization, 
and the like in accordance with the size of the matrix A. 
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At step 34, a determination is made as to whether the point of interest is within 
the boundaries of the selected simplex. This may be performed, for example, by 
determining if "a" found in step 32 satisfies the following: 

a s > 0 and ^ a* < 1 

5 in which a [? .. a n are the entries in the vector "a". 

In this instance, the point of interest 5c is expressed as a linear combination of n 
vertices having the origin translated to the remaining n+lth vertex. If this linear 
combination is determined to be convex, then the point lies within the simplex. 
1 0 Determining whether the linear combination is convex may be performed by determining 
if all coefficients are positive and sum to less than 1, as set forth above. Other 
embodiments may use different processing steps to make a determination of step 34. 

If the determination at step 34 is such that the point of interest x is not within the 
1 5 simplex or is not on the boundary of the simplex, control proceeds to step 40 where the 
next combination of n+1 data points is selected to form the vertices of the next simplex to 
be tested. At step 42, a determination is made as to whether all combinations of points 
have been processed indicating that all simplices have been tested. If not, control 
proceeds to step 22 for the next loop iteration using the next selected simplex. If all 
20 simplices have been processed, it means that no candidate simplex tested contains x , and 
control proceeds to step 44 to take an alternate action. Alternate actions are discussed in 
more detail in following paragraphs. 
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If, at step 34 it is determined that the 3c is within the simplex or on the boundary 
of the simplex, control proceeds to step 36 where a linear surface is fit to the simplex 
vertices by solving the linear equation for a vector "b" of dimension n+1 : 

b T B = u T 

where values of the function at points v(j) are denoted as u(j) 5 j = 1 ..n+1 such that "u" is 
a vector defined in terms of all the u(j)'s as a transpose matrix: 

u=[u(l), u(2),...,u(n+l)] T 
and B is an n+1 x n+1 matrix represented as: 




v(l) v(2) ...v(#i + l) 
1 1 1 



As described elsewhere herein, any one of a variety of different techniques may be used 
to solve the foregoing linear equation in accordance with particulars of the matrix B 
including, for example, the size of the matrix, whether data included therein is colinear, 
whether the matrix is singular and the like. 

Control proceeds to step 38 where the fitted linear function is evaluated at point 
x . In other words, to obtain the corresponding interpolated value y , the function value 
at x is approximated as: 

y = XLi bi Ui + b n+ i 

where bi, b2, . . . b n +i are elements of the vector b computed at step 36, and Uj is an ith 
element of the transpose vector u defined above. 
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In connection with step 44, alternate actions may be performed in the event that 
the none of the candidate simplices encloses 3c , or alternatively includes 3c on the 
boundary of the simplex . An embodiment may increase the size of K and select a new 
5 set of candidate data points; form new simplices and again perform processing of 
flowchart 10. However, it should be noted that as K increases, the number of possible 
combinations of n + 1 points from among n+K candidates also increases sharply and may 
utilize an amount of computation time that is impractical. As described elsewhere herein, 
the foregoing proposed approach for interpolation has a goal of reducing required 
1 0 computational effort. Therefore, it may be preferred to keep the parameter K constant. 

An embodiment may also utilize an alternate interpolation technique, such as 
revert to nearest neighbor interpolation upon failure to determine a suitable simplex fails. 
The nearest neighbor technique may provide for using the value of y corresponding to 
1 5 data point z(l),the closest neighbor already determined in previous processing steps 

described elsewhere herein. Other embodiments may use other alternative interpolation 
techniques besides the nearest neighbor. 

Yet another possibility for alternate action taken at step 44 is to perform linear 
20 extrapolation using one of the already tested simplices. In other words, it has been 

determined at step 34 that the data point 3c is not within the boundaries of a candidate 
simplex. Accordingly, select the simplex to which the data point 3c is closest to its 
interior. In one embodiment, this may be determined by monitoring the degree to which 
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the condition is step 34 is violated and selecting the simplex with the smallest violation 
such that the point it is close to its interior. In an experimental implementation, the 
numerical criterion to assess the degree of violation for each vector "a" consisting of 
elements ai, a 2 , a n is: 

5 max (max j (-aj), ai) 

Other embodiments may use other determinations to assess the degree of violation 

An embodiment may also select the simplex consisting of the n+1 nearest 
neighbor data points z(l), z(2), . . . , z(n). 

10 

It should be noted that the foregoing are some alternative techniques that may be 
used in an embodiment and not meant to be an exhaustive list. Other embodiments may 
include other techniques used alone or in combination with those described herein. 

1 5 The foregoing interpolation technique assumes that no colinearity exists in the 

experimental data points. In this instance, the matrices A and/or B are full rank as may 
be typical of experimental data in which no controls are placed upon generating the 
values for the experimental data points. 

20 If some regularity is present in the experimental data, for example, if some 

components of x are controlled and appear in equal intervals, many of the candidate 
simplices may be degenerate. Accordingly, the method selected to solve the linear 
equations, such as in steps 32 and 36, may account for the possibility of A and B being 
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singular, or approximately singular depending on the particular precision, for example, of 
hardware and/or software and numerical computation techniques utilized in an 
embodiment. An embodiment may include additional test steps prior to solving linear 
equations to determine of the matrices are singular. If so, appropriate techniques may be 
5 used to solve the linear equation. Possible approaches include, for example, using 
singular value decomposition methods or solving the equations through use of matrix 
pseudoinverse. Such techniques may be performed in an embodiment, for example, by 
invoking an available subroutine or function, such as may be available in Matlab, 
incorporating the functionality to solve the equations. 

10 

In the event that the matrices A and/or B are determined to be singular, an 
embodiment may also add a random "jiggle" factor to the data points to destroy 
colinearity. This "jiggle factor" may be empirically determined by execution with 
different values to determine how much a particular jiggle factor affects or varies the 
1 5 data. An embodiment may add a jiggle factor to the data points sufficient to prevent the 
matrix from being singular but not large enough to practically alter the results. 

It should be noted that due to finite numerical accuracy, a failure determination 
may result from processing at step 34 even though a data point is indeed within a 
20 candidate simplex. This depends upon the precision of the data representations in an 

embodiment. An embodiment may add an error factor to the conditions used in making 
the step 34 determination to take this into consideration. For example, an embodiment 
may modify the conditions previously described in step 34 processing to be: 
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aj> -81 and 

^ =i a/< 1 + ^2,, with e\ and si chosen to reflect condition of matrix A. An 
embodiment may select: 
s 1 = n4n£ 

5 where £ is based on a processor or hardware and/or software characteristic. 

As described above, an embodiment may use distance to select candidate simplex 
vertices. This may make the foregoing technique sensitive to scaling however. An 
embodiment may scale data before performing the foregoing interpolation technique so 
1 0 that the ranges of all coordinates of x are the same across the data set. 

The foregoing interpolation technique blends advantages of linear interpolation 
and nearest neighbors approaches. The search for appropriate simplices is greatly 
simplified when compared to the standard Delaunay-based approach. A simple test is 

15 used to test whether the point in question lies inside the candidate simplex. Additionally, 
the foregoing technique does not require that all simplices be evaluated. Rather, a subset 
of simplices are evaluated and the foregoing embodiment stops at the first simplex within 
which it is determined that the desired data point exists. An embodiment may also utilize 
other techniques for selecting a simplex from the candidate simplices since a single data 

20 point may be found to exist within more than one simplex. 
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The foregoing technique selects the first simplex which contains the point of 
interest. An embodiment may also use other techniques in selecting a simplex, for 
example, when there are a plurality of simplices that are determined to enclose, or 
approximately enclose, the point of interest. For example, an embodiment may perform 
5 the processing steps herein until a first predetermined number of simplices are found, 
until a predetermined number of simplices are examined, until a predetermined time limit 
has expired, and the like. If there are multiple simplices, an embodiment may 
accordingly select one of the simplices using any one or more of a variety of evaluation 
techniques, for example, such as selecting the simplex within which the point of interest 
10 is closest to the center of the simplex. 

Using the foregoing technique affords the advantage of scalability since the 
numerical complexity grows at a slower rate than that of the Delaunay method, and the 
foregoing technique therefore may be used with data sets having dimensions greater than 
15 those which are feasible with the Delaunay method. However, the foregoing technique 
may result in a surface of the overall interpolated function that is also no longer 
continuous. In addition, the search for a proper simplex may fail, and either linear 
extrapolation, the nearest neighbor approach, or another alternate action may be taken as 
described elsewhere herein. 

20 
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What will now be described is an example of the foregoing technique. It should 
be noted that although this is a two-dimensional example, the techniques described 
herein may be applied to other dimensions. In this example, each data point in the 
database of experimental measurements consists of a two dimensional vector \(k) and 
the associated measured function value y(k) . Suppose there are m = 9 data points, given 
by: 



x(l) = 
i(4) = 
x(7) = 



1 

1.5 



, v(l) = 0 x(2) = 

,v(4) = 17.5 x(5) = 
,^(7) = 2.25 x(8) = 



1.5 
3 
2 
3 
'3' 
0 



v(2) = 6 

,y(S) = n 

, v(8) = 0 



x(3) = 
x(6) = 
x(9) = 



0.5 

4 
"1.5 

1 
0 



,y(6) = 2.0 
y(9) = 2.5 



These data points x(k) are depicted in graph 80 of Figure 4. A three dimensional graph 
of pairs (x(k),y(k)) is graph 100 of Figure 5. 



x = 



1.4 
1.2 



Using the foregoing data points, suppose the interpolated function value for 
is to be computed using the methods steps set forth in the flowchart 10. The 



parameter K of the interpolation procedure is equal to K=2. 

The distance between x and every x(k) : d k = ||x - x(k)\\ is determined. These 
20 distances for the data points are: 

d x = ||x - x(l)|| = 1.9105 d 2 = ||x - x(2)|| = 1 .7029 d, = ||x - x(3)|| = 2.8460 

d, = ||x - x(4)|| = 4.03 11 d 5 = ||i - x(5)|| = 1 .8028 d 6 = ||x - x(6)|| = 0.3 1 62 
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d 1 = ||x - x(7)|| = 0.4472 d s = ||x - x(8)|| = 2.0616 d 9 = ||x - x(9)|| = 3.9560 

This represents determining the distances described previously in processing steps 16, 26 
and 28. 



Through partial sorting of distances d k , the n+K-A lowest values of d k may be 
determined, and the corresponding n+K nearest neighbors of x among x(k). The 
shortest distances among the nine values above are d 6 ,d 7 ,d 2 ,d 5 . Therefore the four 
nearest neighbors of x are denoted: 



z(l) = x(6) = 



1.5 
1 



z(2) = x(7) = 



1 

1.5 



z(3) = x(2) = 



1.5 

3 



z(4) = x(5) = 



10 



This represents processing of steps 18 and 20 as described in flowchart 10. 



Iterations are performed over all combinations of w+l=3 points from among the 
n+K=4 selected nearest neighbors. The iterations are over the loop including the steps 
15 24, 30, 32, and 34. In this case there are four such triples: (z(l), z(2), z(3)), 
(z(l),z(2),z(4)), (z(l),z(3),z(4)), (z(2), z(3), z(4)). Each of these triples are tested 
until it is determined that one form a simplex that encloses the point x . If there is no 
such triple, then alternate action may be taken as described elsewhere herein in 
connection with step 44. 

20 

For the first iteration, a first simplex, which in this instance is a triangle, has the 
following vertices: 
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v(l) = z(l) = 



1.5 
1 



v(2) = z(2) = 



1 

1.5 



v(3) = z(3) = 



1.5 

3 



10 



The origin of the coordinate system is shifted to v(l) , as set forth in step 24. The vertices 
of the simplex with this new origin are: 



5 v(l) = v(l)-v(l) = 



v(2) = v(2)-v(l) = 



-0.5 
0.5 



v(3) = v(3)-v(l) = 



Additionally, the point at which interpolation is desired now becomes 

X = x - v(l) - 



-0.1 
0.2 



As in step 30, an n by n matrix A = [v(2), v(3),K , v(« + 1)] = [v(2), v(3)] = 



-0.5 0 
0.5 2 



is formed. 



As in step 32, the linear equation Aa = x is solved for the unknown vector a . The 

[0.2 

solution in this example is a = 

0.05 



In performing the determination if the point x is within the boundaries of the simplex 
1 5 at step 34, it is determined if all components of a satisfy a t > 0 and ^T" a i = 0.25 < 1 . 

In this example, it is determined that the point x lies inside the triangle formed by 
vertices v(l) , v(2) , v(3) , or equivalently that the point x lies inside the triangle formed 
by vertices v(l),v(2), v(3). The YES branch of step 34 is followed and control 
proceeds to step 36. Otherwise, if x is determined not to be inside the simplex, control 
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would have proceeds to step 40 for iteration 2 with the simplex v(l) = z(l) , v(2) = z(2) , 
v(3) = z(4)). 



In connection with processing of step 36, values of the function at points v(y') are 
5 denoted as u(j) , that is u(l) = 2 , w(2) = 2.25 , «(3) = 6 . In this instance, the following 
vector is formed: 



10 



u 



2 
2.25 
6 



An n+l by n+\ matrix is also formed as: 



B 



1.5 1 1.5 
1 1.5 3 
1 1 1 

The vector u and the matrix B are used in solving the linear equation b r B = u r for the 



v(l) v(2) v(3) 
1 1 1 



unknown vector b . In this example, the result is b = 



1.5 

2 

-2.25 



Processing continues with step 38 where the fitted linear function is evaluated at 
1 5 point x to find the required value: y = 6,5c, + b n+x =1.5*1.4 + 2*1.2- 2.25 =2.25 . 



20 



The final result of the interpolation procedure is that the interpolated function value at 
point x is f(x) = y = 2.25 . The simplex (triangle) that includes the point of interest x is 
shown in the graph 200 of Figure 6. The interpolating surface in the three-dimensional 
space is depicted in the graph 300 of Figure 7. 
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Contrasting the foregoing technique with the Delaunay-based interpolation, the 
graph 400 of Figure 8 shows the Delaunay triangulation of this data set with the 
enclosing triangle outlined. Note that the Delaunay technique selected a different triangle 
than the one described herein and the simplex selected by the Delaunay technique 
5 includes vertices that are not the three nearest neighbors of x . 

Use of linear interpolation on this triangle leads to the function value y = 2A6.lt 
should be noted that this resulting value is higher than the resulting interpolated value 
produced using the technique described herein. This illustrates the fact that with different 
1 0 choices of the enclosing triangle or other simplex, the interpolated function value may 
vary. 

Referring now to Figure 3, shown is an example of an embodiment of a computer 
system in which the foregoing interpolation technique may be executed. The computer 

1 5 system 50 includes a data storage system 52 connected to host systems 54a-54n, and a 
data manager system 56 through communication medium 58. In this embodiment of the 
computer system 50, the N hosts 54a-54n and the data manager system 56 may access the 
data storage system 52, for example, in performing input/output (I/O) operations or data 
requests. The communication medium 58 may be any one of a variety of networks or 

20 other type of communication connections as known to those skilled in the art. The 

communication medium 58 may be a network connection, bus, and/or other type of data 
link, such as a hardwire or other connections known in the art. For example, the 
communication medium 58 may be the Internet, an intranet, network or other 
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connection(s) by which the host systems 54a-54n 5 and the data manager system may 
access and communicate with the data storage system 52, and may also communicate 
with others included in the computer system 50. 

5 Each of the host systems 54a-54n 5 the data manager system 56, and the data 

storage system 52 included in the computer system 50 may be connected to the 
communication medium 58 by any one of a variety of connections as may be provided 
and supported in accordance with the type of communication medium 58. The processors 
included in the host computer systems 54a-54n and the data manager system 56 may be 
1 0 any one of a variety of commercially available single or multi-processor system, such as 
an Intel-based processor, IBM mainframe or other type of commercially available 
processor able to support incoming traffic in accordance with each particular embodiment 
and application. 

15 It should be noted that the particulars of the hardware and software included in 

each of the host systems 54a-54n and the data manager system 56, as well as those 
components that may be included in the data storage system 52 are described herein in 
more detail, and may vary with each particular embodiment. Each of the host computers 
54a-54n, as well as the data manager system 56, may all be located at the same physical 

20 site, or, alternatively, may also be located in different physical locations. Examples of 
the communication medium that may be used to provide the different types of 
connections between the host computer systems, the data manager system, and the data 
storage system of the computer system 50 may use a variety of different communication 
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protocols such as SCSI, ESCON, Fibre Channel, or GIGE (Gigabit Ethernet), and the 
like. Some or all of the connections by which the hosts, data manager system 56 and data 
storage system 52 may be connected to the communication medium 58 may pass through 
other communication devices, such as a Connectrix or other switching equipment that 
5 may exist such as a phone line, a repeater, a multiplexer or even a satellite. 

Each of the host computer systems as well as the data manager system may 
perform different types of data operations in accordance with different tasks executing in 
each of the hosts. In the embodiment of Figure 3, any one or more of the host computers 
1 0 54a-54n may be executing instructions to perform the foregoing interpolation techniques. 
The host may subsequently issue a data request to the data storage system 52 to perform a 
data operation, for example, to retrieve experimental data and/or store generated 
interpolated data. 

1 5 The data storage system may include any one or more data storage devices 

ranging from, for example, a single disk drive to a networked plurality of different types 
of data storage devices. 

The instructions that may be executed by processors included in the host 
20 computers may be stored in any combination of hardware and/or software including, for 
example, machine executable instructions input from a read-only-memory (ROM), 
machine-language instructions stored on a data storage device in which the machine- 
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language instructions have been generated using a language processor, software package, 
and the like. . 



Although the foregoing techniques may be used in connection with generating 
5 training data sets for use with neural networks using limited experimental data 

characterized as scattered and non-uniform, these same interpolation techniques may also 
be utilized with input data characterized as uniform. The foregoing interpolation 
techniques may use as input the limited experimental data to produce a more complete 
training data set uniformly covering a desired ranged of expected inputs. The neural 

1 0 networks may, for example, be used in connection with performing data fusion. The 
foregoing interpolation techniques are scalable for use with models having higher 
dimensions without incurring the limitations, such as associated computational and 
storage costs, that may be associated with existing techniques. The techniques described 
herein may also be used in generating data sets for verification of neural networks trained 

1 5 with limited experimental data. The interpolation techniques described herein are 
generally applicable for. use with other applications in which existing interpolation 
techniques may be used to generate additional and more complete data. 

One application of the foregoing techniques may be in an embodiment used to 
train a neural network. In one embodiment, a neural network may be trained to perform 
20 sensor fusion techniques using data generated with techniques as described herein. The 
neural network may be trained to estimate a quantity Y out of obtained measurements 
XI ..Xn. The quantity Y being estimated may be, for example, an estimate of helicopter 
gross weight based on measured flight parameters. The helicopter gross weight may be 
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determined, for example, as a sum of weights of an airframe, fuel, people, cargo, and the 
like. The measured flight parameters may include, for example, velocity, flight altitude, 
engine torque, and the like. In one embodiment, the independent variables may be the 
sensor measurements and the dependent variables may be the helicopter gross weight. In 
5 this application, the experimental data set may be smaller than desired to properly train 
the neural network. The experimental data may also, for example, include only discrete 
values of parameters of interest, such as, for example, flights at velocities of 100, 120, 
140 and 160 knots. Obtaining data sets providing larger, more complete coverage may be 
costly, for example, since helicopter flights are expensive. To properly train the neural 

1 0 network, it may be desired to provide greater variability of the parameters in their entire 
range, for example, to avoid abnormal "oscillatory" behavior of the network in between 
training points. The experimental data set may be used with the techniques described 
herein to populate the input space with artificially created data points to ensure that the 
trained response between the actual measurement points behaves. The foregoing 

1 5 techniques described herein may be used to address overtraining by creating an 

intermediate model of the data using the interpolation techniques described herein and 
then accordingly training the neural network. 

In another application, an embodiment may use the foregoing techniques in neural 
network verification. For example, as described in U.S. Patent No. 6,473,746, which is 
20 incorporated by reference herein, a uniform grid of test points is used to verify the neural 
network. If such a uniform grid of test points is not available, the foregoing techniques 
described herein may be used to generate needed test points from available data points, 
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which may be characterized as scattered. Use of such a uniform grid of test points may 
be desirable for neural network verification. 

What will now be described is an embodiment of a system that may include 
neural nets. Training and/or verification of the neural nets may be performed with data 
5 generated utilizing the foregoing data generation techniques. It should be noted that, as 
described elsewhere herein, a neural network may be used to model various conditions. 
Part of effectively utilizing a neural network includes proper training and verification as 
well as other factors including, for example, properly selecting a neural network 
configuration and architecture. Additionally, as set forth in following paragraphs, the 
1 0 neural network may be used alone or in combination with other techniques and 
components, such as a Kalman filter, in a given system. 

Referring now to Figure 9, shown is an example of one embodiment of a system 
500. The system 500 may be included onboard an aircraft, such as, for example, a 

15 helicopter. The system 500 in this example embodiment includes a gross weight 
processor 505 and a health and usage management system (HUMS) 516. The gross 
weight processor 505 produces as an output the gross weight estimation 512 which may 
be used in connection with other inputs 514 to the HUMS 516 to track the useful life of 
various components of the aircraft as well as predict with different levels of integrity 

20 premature parts failure of components within the aircraft. It should be noted that the 
gross weight estimation 512 of the gross weight processor 505 may be used in 
connection with other applications and components. The gross weight estimation 512 
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may be used as a sole input, or in combination with one or more other inputs, to the 
HUMS and other components as may be included in a particular embodiment. 

It should be noted that the techniques described herein for gross weight estimation 
5 may be used in connection with other systems, such as fuel gauging. The particulars 
described herein should not be construed as a limitation of these techniques. The 
particular components included in a system may vary in accordance with each 
embodiment and/or application. 

1 0 The gross weight processor 505 may be included onboard an aircraft and may also 

be in a location physically separate and apart from the HUMS system 516 or other 
components. The gross weight processor 505 may be located, for example, on an aircraft 
and may communicate data with other component(s) and/or system(s) located, for 
example, at a ground location. The gross weight processor 505 may also be located in a 

1 5 ground station and communicate with other components onboard an aircraft and on the 
ground. 

Sensor measurements and other inputs 502 may be used by the gross weight 
processor 505 to produce the gross weight estimation 512. The sensor measurements and 
20 other inputs 502 may come from any one or more of a variety of different sources. For 
example, the sensor measurements may be obtained using sensors onboard an aircraft 
including the gross weight processor 505. The other inputs may include, for example, 
manual input from the crew, previously obtained data or data stored on a data storage 
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device on the aircraft, data stored remotely with respect to the aircraft, data from a 
configuration file, data stored in a form of memory, such as a RAM, ROM, or PROM, 
and the like. 

5 In an embodiment in which the gross weight processor 505 communicates with 

other components and/or systems not physically co-located with the gross weight 
processor 505, data may be transmitted therebetween using any one of a variety of known 
communication techniques possibly using one or more other communication devices. 

1 0 Included within one embodiment of the gross weight processor 505 is an input 

processor 504 and a gross weight estimator 510. The input processor 504 in one 
embodiment takes as inputs the sensor measurements and other inputs 502, and produces 
as outputs one or more neural net inputs 506 and a regime indicator 508. The neural net 
inputs 506 and regime indicator 508 are input to the gross weight estimator 510 along 

1 5 with Kalman filter inputs 520 to produce a gross weight estimation output 512. The input 
processor 504 in this embodiment may use one or more of the sensor measurements and 
other inputs 502 to produce one or more derived values based thereon. One or more 
derived values as well as one or more of the actual inputs 502 may be used as an input to 
the neural net 506. Additionally, in this embodiment, the input processor 504 also 

20 determines a particular flight regime in accordance with particular inputs 502. The 
particular regime selected by the input processor 504 is indicated as an output on the 
regime indicator output 508. The input processor 504 may use some or all of the inputs 
502 in connection with determining a particular regime and the neural net inputs 506. 
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The particular portion of the inputs 502 used to produce the neural net inputs 506 and the 
regime indicator 508 may vary in an embodiment. 

The regime indicator 508 is a determination of the aircraft's current flight regime 
in accordance with the one or more inputs. As known in the art, a regime is associated 
with different flight states of the aircraft based on one or more aircraft parameters. For 
example, an embodiment may define hover as a first regime, steady state forward flight 
as a second regime and so on. The particular flight state of an aircraft may be determined 
based on measurements and/or other inputs 502. 

The gross weight estimator 510, as will be described in more detail in following 
paragraphs along with other components of the system 500, may include a Kalman filter 
and one or more neural nets. 

Referring now to Figure 10, shown is an example 550 depicting more detail of 
one embodiment of the input processor 504 previously described in connection with 
Figure 9. In one embodiment of the input processor 504, a neural net input processing 
component 552 and a regime recognizer 554 may be included. All or a portion of the 
sensor measurements and other inputs 502 may be used by the neural net input processing 
552. Similarly, all or a portion of the sensor measurements and other inputs 502 may be 
input to the regime recognizer 554. In this embodiment, the regime recognizer 554 
produces as an output the regime indicator 508. The neural net input processing 
component 552 produces as an output one or more neural net inputs 506. In this 
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embodiment, the regime indicator output produced by the regime recognizer may also 
serve as a selection input to the neural net input processing 552. As described in more 
- detail in following paragraphs, the neural net inputs may vary in accordance with the 
particular neural net selected based on the regime indicator. Thus, the regime indicator 
5 may also be an input to the neural net input processing 552 which generates the neural net 
inputs 506. In an embodiment in which the inputs to all the neural nets are the same, the 
regime indicator output may be omitted as an input to the neural net input processing 552. 

It should be noted that although these two components, the regime recognizer 554 
10 and neural net input processing 554, are shown structurally as two different components, 
an embodiment may include processing associated with the components 552 and 554 
within a single structural component. It should also be noted that an embodiment may 
associate functionality with one or more of the components 552 and 554 with other 
arrangements than as described herein. 

15 

It should also be noted that a particular regime may be selected using a predefined 
function or regime mapping described in more detail elsewhere herein. The predefined 
mapping may be implemented, for example, using a programming language and logic 
statements or other expressions of the regime mapping. An embodiment may also 
20 determine a regime based on manual selection or input, for example, from a crew 
member. 
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Referring now to Figure 1 1 5 shown is an example 600 of more detail of one 
embodiment of the gross weight estimator 510 previously described in connection with 
Figure 9. In this embodiment, the gross weight estimator 510 includes one or more 
neural nets 602 and a Kalman filter 606. One or more of the neural nets 602 may be 
5 selected in accordance with the regime indicator 508 to process the neural net inputs 506. 
In this particular embodiment, different neural nets have been trained in accordance with 
differing flight regimes. Accordingly, depending on the particular flight regime of the 
aircraft at a point in time as indicated by the regime indicator 508, one or more 
specifically trained neural nets 602 may be selected to process the neural net inputs 506. 

1 0 The one or more neural nets selected from 602 produce one or more neural net outputs 
604. In this embodiment, the neural net output 604 is a first estimation of the gross 
weight of the aircraft. An embodiment of the Kalman filter 606 may include as inputs the 
neural net output gross weight estimation 604 and other Kalman filter inputs 520 to 
produce a Kalman filter output 608 which is a second gross weight estimation 512. In the 

1 5 embodiment of the gross weight estimator 5 1 0 shown in Figure 1 1 , the neural net output 
604 may be characterized as an intermediate gross weight estimate which may be further 
refined by the Kalman filter 606 in accordance with other Kalman filter inputs 520 to 
produce a final gross weight estimation 512 as an output of the gross weight estimator 
510. 

20 

It should be noted that one or more neural net outputs 604 may be produced by 
the neural nets 602 and used as values input to the Kalman filter 606. For example, if 
two particular neural nets are trained in accordance with a particular selected flight 
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regime, those two selected neural nets may each produce a single output. Both of the 
neural net outputs may be used as inputs to the Kalman filter 606. An embodiment may 
also combine one or more outputs of the neural net 602 selected in accordance with a 
regime indicator 508 as a single signal 604 used as an input to the Kalman filter 606. As 
5 will be described in more detail in following paragraphs, the Kalman filter 606 may be 
characterized as a data fusion module or component blending together one or more neural 
net outputs 604 with one or more Kalman filter inputs 520 to produce a gross weight 
estimation 512. 

10 It should be noted that the regime indicator may also serve as an input to the 

Kalman filter in an embodiment since one or more values used in connection with the 
Kalman filter may vary in accordance with the particular regime selected. Note that this 
is described in more detail elsewhere herein. 

15 It should be noted that although the embodiment of the gross weight estimator 

510 shown in Figure 1 1 includes both one or more neural nets 602 and a Kalman filter 
606, an embodiment may include one or more neural nets alone 602 without the Kalman 
filter. Additionally, an embodiment of a gross weight estimator may include just a 
Kalman filter 606 without including any neural nets. An embodiment may also include 

20 one or both of the foregoing in combination with other components use to produce a 
gross weight output. It is known that a large amount of data may be used to properly 
train one or more neural nets. Additionally, the data used to train and/or verify a neural 
net for a particular regime may not be readily available for training and/or verification 
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purposes. In such instances, it may be desirable to use an alternate technique in 
connection with estimating the gross weight of the aircraft, or alternatively augment the 
gross weight estimate output by a neural net. In one embodiment, for example, it may be 
known that the gross weight estimate produced by a neural net has an associated low rate 
5 of accuracy and reliability due to the amount and/or type of training and/or verification 
data. In this instance, the Kalman filter 606 may use the intermediate gross weight 
estimate (604) using a weighting factor to take into account a less than desirable degree 
of reliability. The Kalman filter may then use the neural net's gross weight estimate, in 
connection with other inputs, to produce a revised gross weight estimate. 

10 

An embodiment that includes both one or more neural nets as well as a Kalman 
filter may also include a hardware or software switching mechanism that enables and also 
appropriately disables one or more of the neural nets 602 and Kalman filter 606. Such a 
switching mechanism may be, for example, set manually or automatically. 

15 

Additional details about the components and techniques that may be used in an 
embodiment of the gross weight estimator 510 are described elsewhere herein. 

Referring now to Figure 12, shown is one example of an embodiment 650 of a 
20 neural net that may be included in a gross weight estimator 5 10. In connection with 

Figure 12, other figures, and paragraphs included herein, the following notation may be 

used: 

Symbols 
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InncntiiHinal appplpratinn 


a. 


vertical acceleration 


bn 


nth layer bias for a neural net (NN) 




weight bias 


H 


measurement transformation matrix 




allilUUC 


TAS 


inHir»5itp*H iii"rcr>pf*H 
lllLllvCllCU aiiopccu. 


OAT 


outside air temnerature 

V ViVulvIV 1411 IVlilL/vlUlUl V 


Q 


process noise covariance matrix 


Q 


engine torque 


R 


measurement covariance matrix 


ROC 


Rate of Climb 


V 


airspeed 


w g 


gross weight 


Wg m ax maximum gross weight 


W H 


weight calculated at hover 


Wn 


nth layer weighting for NN 


W s 


summed gross weight 


w 


process noise 


Wf 


fuel flowrate 


X 


state vector 


z 


measurement vector or input vector 


At 


time step 


9 


state transition matrix 


cl> 


roll attitude 


0 


pitch attitude 


V 


measurement noise 



Subscripts 

i, j 9 k elements of a vector 
m, n elements of a matrix 



Superscripts 
T transpose 

Referring back to Figure 12, the neural network 650 may be characterized as a 
feedforward neural network with a single hidden layer. The neural network 650 includes 
an input layer in which each input is connected to each neuron of the hidden layer. One 
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embodiment of the neural net 650 uses as its activation function associated with each of 
the neurons of the hidden layer the hyperbolic tangent (tanh) function. It should be noted 
that although the embodiment 650 shown in Figure 12 contains a single hidden layer, an 
embodiment of a neural network used in the gross weight estimator 510 may include a 
5 different number of hidden layers as well as a different number of neurons than as shown 
in the embodiment 650. Similarly, an embodiment may also include other variations of a 
neural network than as described herein such as, for example, using a different activation 
function, providing for different interconnections between the input layer and the hidden 
layer as well as in between one or more hidden layers. The particular neural network 
10 shown in the embodiment 650 of Figure 12 should not be construed as a limitation of the 
techniques described here in connection with determining the gross weight of an aircraft. 

The neural nets 602 used within an embodiment of the gross weight estimator 510 
may be selected from a pool of pre-trained neural networks. The particular neural nets 

1 5 602 included in an embodiment of the gross estimator 510 may be determined as those 
neural networks providing the best estimate of gross weight for one or more particular 
flight regimes. Training of one or more static feedforward neural networks may be used 
to represent deterministic mappings for which a gross weight estimation by itself may be 
determined as an output value of the gross weight estimator 510. The neural nets 602 

20 used in the gross weight estimator 510 may be trained offline prior to use. Subsequently, 
the one or more neural nets 602 may be operated and used on line, such as when an 
aircraft is in flight, to determine the gross weight of the aircraft. In other words, the 
particular neural nets 602 included in one embodiment of the gross weight estimator 510 
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are not trained on line and do not use any adaptive technique. The neural net weights 
determined during the offline training phase are fixed and used in subsequent on line 
operations of the gross weight estimator 510 such that if the same input vector is used 
with a neural network multiple times, the neural network produces the same output 
5 exhibiting deterministic behavior. 

Referring now to Figure 13, shown is a flowchart 700 of steps that may be 
performed offline prior to operation of the gross weight estimator 510 in determining the 
aircraft's gross weight. The steps of flowchart 700 may be performed for one or more 

1 0 neural nets associated with one or more particular flight regimes. At step 702, compiled 
data representative of the actual system may be obtained. This compiled data may be, for 
example, from previous data acquisitions during operation of the aircraft in one or more 
different flight regimes. The compiled data may represent only a portion of the data 
actually used to train and or verify a neural net in subsequent processing steps. The 

1 5 compiled data may also come from experimentally generated data, such as in connection 
with a model. At step 704, the compiled data may be used in connection with creating 
training data. Any one of a variety of different techniques may be used in connection 
with creating the training data including, for example, one or more interpolation 
techniques as described elsewhere herein. At step 706, the one or more training 

20 parameters and appropriate neural network configurations may be determined. In one 
embodiment, multiple neural networks may be determined for one or more particular 
flight regimes, and one or more training parameters selected. At step 708, the one or 
more neural networks may be trained. At step 709, a determination is made as to whether 
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the neural network training is done. This determination may be performed, for example, 
with a reserved portion of the training data as described elsewhere herein in more detail. 
Step 709 may be characterized as a first level determination as to whether the neural net 
training has been successful. If not, control proceeds to step 708 for further training. 
5 Otherwise, control processed to step 710 for verification. Step 709 processing may 

include, for example, determining if the neural net results for a predetermined number of 
iterations appear to be converging within a predetermined threshold. From step 710, 
control proceeds to step 712 where a determination is made as whether the neural net 
results of the one or more known networks for each particular flight regime are 

1 0 determined to be satisfactory. If so, control proceeds to 714 where one or more of the 

neural networks may be evaluated and selected as the ones to be used in connection with 
the gross weight estimator 510. For example, at step 714, one or more of the neural 
networks trained for a particular flight regime may be evaluated as "best" in accordance 
with various criteria. The criteria may include, for example, minimizing the root mean 

1 5 square (RMS) error between desired and actual output. At step 712, results may be 

determined as "satisfactory", for example, if one or more neural nets produce results that 
converge within predetermined limits for the verification data testing. Additionally, an 
embodiment may determine that results are "satisfactory" if all of the error indicators 
associated with each net are clustered together within a certain amount of one another 

20 such that the overall variance of all results is within a predetermined amount. The 

particular criteria with a determination of "satisfactory" used at step 712 may vary with 
each embodiment. In one embodiment, the RMS error may be determined using the 
actual gross weight as determined by the neural network and the actual gross weight. It 
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should be noted that the actual gross weight may be determined, for example, by adding 
together known values of helicopter weight, fuel, and the like. 

If it is determined at step 712 that the results are not satisfactory as produced by 
5 the verification step, control may return to either step 706 or 704 in an embodiment. Any 
one or more different elements used in determining the neural nets of step 714 may be 
adjusted. For example, the particular training parameters may be varied. The actual 
architecture of the neural network as well as activation functions used therein may be 
varied. Additional training data may be generated or checked for bad data in accordance 

1 0 with one or more verification techniques. An embodiment may perform any one or more 
of the foregoing as well as other well known variations to produce the one or more 
trained nets of step 714. Once one or more adjustments have been made in connection 
with the data, parameters and/or network configurations associated with the neural 
networks, the neural networks may be retrained and re-evaluated until the results are 

1 5 satisfactory as determined at step 712. Once the neural networks that have been trained 
in accordance with one or more particular flight regimes produce satisfactory results, the 
weight and bias vectors associated with a particular neural network may be fixed as a 
result of training and verification, and may be used in connection with the gross weight 
estimator 5 10 for a particular associated flight regime. Additional details of the 

20 processing steps are described in more detail elsewhere herein. 

In one embodiment, data used with the neural net training and/or verification of 
flowchart 700 may be gathered from an existing database of an SH-60B helicopter flight 
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test data representing a 20,000 lb max gross weight (W gmax ) twin engine helicopter with 
various pilots. To reduce the number of neural net inputs, mathematical and physical 
relationships in the measured data may also be used to generate data reduction functions. 
In one embodiment, information from 9 sensors may be gathered and used to derive 5 
5 neural net inputs. Sensed data may include both engine torques (Qi, Q2), Outside Air 
Temperature (OAT), pressure altitude (Hp), Indicated Airspeed (IAS), Rate of Climb 
(ROC), vertical acceleration (a z ), pitch attitude (0), and roll attitude (d>). 

It should be noted that the particular neural net inputs used in producing a gross 
10 weight estimation may vary in accordance with a particular regime definition. For 

example, for the steady state forward flight regime, attitudes (Roll and Pitch) may not be 
used as neural net inputs due to the nature of the regime criteria, reducing the number of 
neural net inputs for this regime to five (5). However, an embodiment may use these as 
neural net inputs directly or in connection with producing a derived parameter which is a 
1 5 neural net input as described elsewhere herein in more detail. 

The regime recognizer 554 illustrated in the on-line system of Figure 10 may also 
be used in identifying what sets or vectors of training data may be used with a particular 
regime. In other words, the regime recognizer 554 may be used in both the off-line 
20 processing to produce the trained neural nets, and the on-line processing system 500 of 
Figure 9. In connection with the off-line processing of step 706 of the flowchart 700, a 
particular set of data may be input to the regime recognizer 554 to determine the regime 
corresponding to the input data. One embodiment of the regime recognizer takes 'V 55 
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aircraft parameters, such as attitudes, accelerations, velocities, Weight On Wheels 
(WOW), and the like, and divides the input space formed by these "v" parameters into a 
matrix of subspaces assigning a regime to each subspace. 

5 Referring now to Figures 14-16, shown are examples of the regimes that may be 

defined in one embodiment as used by a regime recognizer. It should be noted that in one 
embodiment described herein in connection with Figure 14-16, the regime definitions 
may be characterized as "effective regimes" in which each "effective regime" includes 
one or more "actual regimes". This may occur in an embodiment, for example, if each of 
1 0 the actual regimes included in an effective regime may use the same one or more trained 
neural nets. In an embodiment as described herein, an effective regime is a set union of 
all the designated actual regimes. 

1 5 Referring now to Figure 14, an embodiment of a definition of the steady state 

hover regime is illustrated in accordance with the flight parameters of the table 820. 
The WOW (weight on wheels) flag with a value of true or 1 indicates that the aircraft is 
on the ground. In arrangement, the WOW may be a switch set in accordance with a 
deflection in wheel struts. The particular technique used in determining the WOW flag 

20 may vary in accordance with the particular aircraft. With reference to the drift velocity 

and ground airspeed in table 820 and elsewhere herein, the units are in knots. The control 
reversal flag indicates whether the aircraft has made a movement from one direction to 
another returning to the original position. Such a movement may be made, for example, 
by a pilot in reaction to a gust loading. 
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It should be noted that in reading the data contained in tables of Figures 14-16, the 
some parameters appear in two rows of a table. This is to specify that the parameter 
range of values is formed by logically ORing the ranges specified with each row in the 
5 table. For example, in table 820, the Yaw rate for the hover regime is defined as those 
values which are both less than or equal to 2.5 and also greater than or equal to -2.5, 
inclusively. 

The hysteresis column of data in each of the tables of Figures 14-16 includes a 
1 0 value of NONE or a numeric value. The hysteresis value may be used in the actual on- 
line system in determining a flight regime indicator in real time, such as when used in the 
on-line processing. Values of flight parameters obtained in real time may not behave in a 
consistent fashion once a particular regime has been entered. For example, a parameter 
value may increase in accordance with one mathematical representation. However, as the 
1 5 value decreases, the same function or representation may not apply. As such, a parameter 
value which changes in small amounts close to a regime border condition may cause the 
regime definition to constantly change if hysteresis of the appropriate parameter(s) is not 
taken into consideration. Referring to the hover regime of table 820, one embodiment 
determines that hysteresis is taken into account for only the calibrated air speed. The 
20 value, 5, included in the table 820 for the calibrated airspeed hysteresis factor specifies 
that once the regime indicator determines that at a time t=n the hover regime is entered, 
the regime indicator value does not change for values of threshold + the hysteresis value 
(38+5, or 43) in this instance. In order to change regimes based on the calibrated 
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airspeed parameter value once in the hover regime, the calibrated airspeed must be more 
than 43 knots. 

It should be noted that in this embodiment, the attitudes are in degree units, the 
5 airspeed is in knots, the yaw rate is in degrees/second, and the ROC is in feet/minute. 

Referring now to Figure 15, an embodiment of a definition of the steady state 
forward flight regime is illustrated in accordance with the flight parameters of the table 
840. 

10 

Referring now to Figure 16, an embodiment of a definition of the turn regime is 
illustrated in accordance with the flight parameters of the table 860. 

Other embodiments may use other regime definitions than as described herein. 

1 5 The foregoing regimes may be implemented in an embodiment of a regime recognizer as 
sets of conditionals, i.e. set of discrete and floating point comparisons combined with 
logical conditions. At any single point in time, only one regime is valid. Another way of 
stating this is that each regime is mutually exclusive from the other regimes so that, any 
given input vector of flight parameters maps to only a single regime. The parameters 

20 used to define a regime space may vary based on the platform. How the entire input 
space is broken into subspaces, the regimes to be detected, may vary with each 
embodiment and particulars associated therewith. For example, the regimes may vary 
with aircraft manufacturer. Additional parameters used to define an actual or effective 
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regime may be added, or also varied from those specified for a particular platform by a 
particular embodiment. The parameters described herein, for example, may be used with 
the Navy SH-60B helicopter and an embodiment of a HUMS system as illustrated in 
Figure 9. 

5 

What will now be described are the "actual regimes" comprising each of the 
"effective regimes" used in one embodiment. In one embodiment, three effective 
regimes may be used: hover, forward flight, and turn, as illustrated and described 
elsewhere herein in connection with Figures 14-16. In one embodiment, it was 

1 0 determined that no more than five neural net inputs for any regime may be used. The 
particular number of neural net inputs may vary as described elsewhere herein. In one 
embodiment, for example, the number of neural net inputs considered was limited by the 
Neural Net toolbox of Matlab. Other embodiments may have other limitations and 
considerations in connection with selection of the number of neural net inputs as well as 

1 5 the neural net inputs themselves. In this embodiment, the flight envelop of possible 

regimes may be partitioned so that the neural nets may successfully converge on a gross 
weight estimate with a reasonable confidence. An embodiment for an SH-60B helicopter 
platform may do this by reducing the existing regime set (of "actual" regimes) into higher 
level ("effective") regimes. The neural net inputs that may be included in an 

20 embodiment are described in more detail elsewhere herein. 

Referring now to Figure 17, shown is an example 860 illustrating how multiple 
actual hover regimes are mapped to a single effective hover regime that may be included 
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in one embodiment. It should be noted that the hover effective regime is described in 
connection with Figure 14 elsewhere herein. The particular actual regimes and effective 
regimes included in an embodiment may vary with platform and other particulars of each 
embodiment. 

5 

Regarding the effective hover regime defined herein, two actual regimes, the 
inground effect (IGE) and out of ground effect (OGE), may be combined into a single 
effective regime in an embodiment. In this embodiment, the neural net for the effective 
hover regime may take into account for any effects between the IGE and OGE by 

1 0 introducing radar altitude, such as height above ground level, as a parameter. As known 
to those of ordinary skill in the art, ground effect is an aerodynamic and rotordynamic 
concept. The outcome of IGE is a reduction of power required for net lift. Whether an 
aircraft is in the state of IGE or OGE may be estimated based on height above ground 
level, such as altitude, and may also vary with the diameter of the main rotor of the 

1 5 aircraft. 



Referring now to Figures 18-27, shown are examples of multiple actual fast 
forward regimes that may be mapped to a single effective fast forward flight regime that 
may be included in one embodiment. It should be noted that the fast forward effective 
20 regime is described in connection with Figure 15 elsewhere herein. 



Referring now to Figures 28-29, shown are examples of multiple actual turn 
regimes that may be mapped to a single effective turn flight regime that may be included 
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in one embodiment. It should be noted that the turn effective regime is described in 
connection with Figure 16 elsewhere herein. It should be noted as used herein, AOB 
refers to "angle of bank". 

5 The foregoing definitions of actual and effective regimes may be used in an 

embodiment of the regime recognizer 554 to output a regime recognizer indicator 508. 
It should be noted that an embodiment may include a default or catchall regime which is 
the selected regime in the event that no other regime criteria are met. The regime 
recognizer in an embodiment may include any type of regime mapping. However, a 
1 0 regime needs to be defined for the range of possible inputs. An embodiment may also 
combine a manual selection technique with the use of an automated or predefined 
mapping function for regime selection. 

It should also be noted that the foregoing regime definitions may be mapped to 
1 5 other regime definitions when the gross weight output, as produced using techniques 
described herein, is used as an input to other systems and/or components, such as an 
HUMS. 

In one embodiment to reduce the number of neural net inputs, the following 
20 derived parameters are calculated from mathematical and physical relationships in the 
measured data: 

Corrected Vertical Acceleration (cN z ) NN INPUT 1 
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cN 2 =l + N z -\ 



cos 



Where 



N z is Vertical Acceleration 
0 is Roll Attitude 



Torque Coefficient (Cq) 

Q 



Cq = 



NN INPUT 2 
412.0/100.0* (Eng\Q+Eng2Q)/ 2.0 



pA(QRy 



Nr ?S7 887 
.0023769 *a*7rR 2 *(2*x* — * *R) 2 

100 60 



Where Q is total torque (RPM) 

10 p is density (lb-sec 2 /ft 4 ) 

A is the area of the main rotor disc (ft 2 ) 
Q. is the rotation speed of the rotor (rad/s) 
R is the radius of the main rotor disc (ft) 
Nr is the main rotor speed (%) 

15 a is the density ratio 



20 Advance Ratio (p) 

V HAS* 1.6890 

M = 



QR M-. 2S7.887 



100 60 
Where KIAS is indicated airspeed in knots 



NN INPUT 3 



25 



Climb rate over tip speed (pc) 

V c ROC/ 60 
Mc = — = 



OR Nr . 257 M7 

100 60 
Where ROC is rate of climb (ft/min) 



NN INPUT 4 



30 



Density Ratio (a) 

<r = 0.0023769 *(■ 



288.15 



NN INPUT 5 



OAT + 273.15 



■)*0 -(0.0019812* 



Hp 



288.15 



)) 



5.256 



35 



Where OAT is outside air temperature (°C) 
Hp is Barometric Altitude (ft) 
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The foregoing parameters, together with Roll Attitude and Pitch Attitude (when 
attitude is a factor) may be used as inputs to the appropriate neural net in accordance with 
the selected flight regime. 

5 In connection with obtaining the data in step702 of Figure 13, an embodiment 

may also remove invalid data using data quality checks. These data quality checks may 
include, for example, discarding "stale data" not received from a bus within a 
predetermined time period, such as 3 seconds, data out of a predefined range or rate of 
change, data which may be indicated as invalid from another source, and the like. In one 
1 0 embodiment, the data may be aligned to a once per second frame. 

In connection with step 704 of Figure 13, compiled or gathered data may be used 
to create training data. In one embodiment, training data is generated for each of the 
foregoing defined parameters. Generation of data may include, for example, determining 

1 5 derived neural network inputs based on raw input data, such as sensor values. Generation 
of data may also include using, for example, an interpolation or other technique as 
described elsewhere herein and known to one of ordinary skill in the art. In one 
embodiment to create one training vector, a random selection for each variable, except 
Cq, is made from within its permitted range. An embodiment may scale the input values 

20 within a range, such as -1 to +1, and select a value randomly based on this scaled input 
value range for each parameter. Cq depends partially on a. Given the value of a, the. 
permitted range of Cq is calculated. Then, the value of Cq is chosen randomly from 
within that range. This process is repeated as many times as needed to create sufficient 
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training data. Sufficiency of training data may be determined in connection with later 
processing steps such as, for example, when increasing the number of data points 
between subsequent iterations fails to improve the neural network result, such as with 
respect to the RMS error rate associated with the subsequent iteration. As described 
5 elsewhere herein, different adjustments may be made when the neural networks do not 
produce satisfactory results. These adjustments may include, for example, increasing the 
amount of training data, changing the type of training data, altering the architecture of the 
neural network, and the like. 

10 In connection with generation of training data of step 704 based on a smaller 

amount of gathered data using the foregoing defined neural net inputs, any one or more 
different data generation techniques may be used. For example, an embodiment may use 
the interpolation technique described elsewhere herein. An embodiment may also use 
other multivariable interpolation techniques, such as, for example, Matlab's routines for 

1 5 Delaunay tessellation, and then using nearest neighbor interpolation. In one embodiment, 
the basis for the interpolation is the original scaled data in which the original input data is 
scaled or normalized to a value in the range from -1 to +1, inclusively. It should be noted 
that such techniques for data generation are well-known. For example, Delaunay 
tessellation as described in Aurenhammer, F., "Voronoi diagrams — A survey of a 

20 fundamental geometric data structure, " ACM Computing Surveys, 1991 , 23:345-405. 

In one embodiment, the neural net architecture for each neural net trained at step 
708 is illustrated in Figure 12 with a single hidden layer of 35 neurons. In arriving at the 
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choice of neural network in an embodiment, several different variations may be tested. 
For example, the inventors used several different feedforward neural nets with the single 
hidden layer and other particulars described elsewhere herein varying the number of 
neurons in the hidden layer. Based on experience, the inventors started with 20 neurons 
5 and tried varying the number of neurons in increments of 5. It was found that a neural 
net with 35 neurons converged for the fast forward flight regime with the least amount of 
error. An embodiment may use any one of a variety of different tools in connection with 
training neural networks. For example, creation and training of neural nets may be 
performed using Matlab's Neural Networks Toolbox. The neural network giving the least 
10 RMS testing error may be selected. In one embodiment, the RMS testing error is that 
obtained on the entire set of training data generated at step 704. 

In connection with the actual training of the neural nets at step 708, a percentage 
of the original data from step 702, such as 10% of the data, may be reserved and used in 

1 5 connection with verification at step 710. The remaining 90% may be used to generate 
training data used to train the nets in step 708. In one embodiment, the verification in 
step 710 may be performed by cross-validation of the neural net results. In one 
embodiment, the original input data obtained at step 702 may be split randomly into ten 
partitions, divided as evenly as possible. For each of the ten partitions, 10% of the 

20 original input data may be reserved for use in the verification step 710. The remaining 
90% of the data of each partition may be used to create the training data in step 704 for 
training the five nets for the fast forward steady state flight regime as described above in 
step 708. 
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It should be noted that an embodiment may use more than 10 partitions and 
different techniques in connection with selection of a neural net for each regime. The 
particular number of partitions may vary in accordance with the amount of data available. 

5 

In connection with the outputs of the neural nets, the values in one embodiment 
are scaled outputs between -1 and 1, inclusively. In this embodiment, a neural net is said 
to converge with a threshold value of 0.001, i.e., if the weight updates reach an 
equilibrium such that the difference between two successive weight values for two 
1 0 successive iterations is less than 0.001 . Other embodiments may use other criteria in 
connection with determining convergence. 

It should be noted that in connection with the processing steps of flowchart 700 of 
Figure 13, there are many possible sources of error, including, but not limited to one or 
1 5 more of the following: 

1 . inherent errors in the use of neural nets, 

2. interpolation error in the creation of training data from the original input data, 

3. the possibility of a greater number or a better choice of parameters, 

4. uncertainty in the parameters themselves, 
20 5. extrapolation, if used in an embodiment 

The foregoing are some factors that may be taken into consideration, for example, 
when step 712 of Figure 13 evaluates to NO for a current configuration of neural nets and 
25 data used in training and/or verification. The foregoing factors represent a set of possible 
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conditions to be examined in order to determine possible adjustments, data modifications, 
and the like, in one or more iterations of the steps of flowchart 700. 



As generally known, extrapolation is a technique in which a known set of 
5 relationships of input(s) and output(s) for a neural net may be used to determine 

relationships for values outside of the known set. For example, values for a first regime 
may be used to determine similar relationships for values outside the first regime. There 
may be error introduced using data in this manner to train a net for a second regime, for 
example, given a set of data for a second different regime. Extrapolation may be used in 

1 0 making a determination as to how "fragile" the neural net results are to changes in the 
inputs. It may be desirable to be able to estimate weight a bit away from nominal input 
values for a given regime. With use of extrapolated data, loss of accuracy is expected, 
but the portion of parameter space for which no estimate is available would be reduced. 
In one embodiment using extrapolation, all the inputs of the compiled actual data at step 

1 5 702 may be scaled to lie between -1 and +1 . The data set may then be split into basis and 
testing sets. The basis set may be used to create training data, which was then used to 
train the best net for this situation. With reference to Figure 13, the basis data is used to 
create the training data at step 704. The basis data in one embodiment is the raw data 
values used to produce derived parameters, the training data of step 704. The net was 

20 then tested on: a. the data it was trained with from step 704, b. all of the input data, from 
step 702, and c. the testing set alone, as part of verification processing of step 710. The 
basis set included those data points in the set from step 702 where all of the inputs are 
between -0.9 and +0.9. The testing set was the remainder of the original data. This may 
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be repeated with a basis set having all inputs between -0.8 and +0.8 and a testing set 
correspondingly defined. 



Based on results determined by the inventors with the foregoing extrapolation, the 
5 inventors have determined that extrapolation may be used to make a reasonable estimate 
of weight outside of a defined parameter space for at least those values extrapolating 
slightly away from nominal range of parameters. 

10 An embodiment may also perform cross-validation with respect to interpolated 

data. For example, if an embodiment has insufficient data at step 702 for proper training 
of the neural nets, as described elsewhere herein, interpolation techniques may be used to 
generate additional training data. In connection with step 710 verification processing, an 
embodiment may also perform cross validation with respect to the interpolated data. In 

1 5 one embodiment, ten-fold cross validation processing may be performed in which a 

reserved set of 10% of the actual data from step 702 may be used for verification. From 
this reserved 10%, additional verification data may be generated using one or more 
interpolation techniques. 

20 In connection with determining gross weight using a set of input parameters, a 

sensitivity analysis may be performed to assess which parameters are most important in 
determining the W g , the inferred gross weight. The sensitivity of W g with respect to the 
k th parameter can be expressed as: 

25 3(Wg)/& A WGT SENSITIVITY 1 
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where z is the vector of input parameters. 



The functional form of W g is assumed unknown. However, it can be estimated to 
within a few percent by the results obtained from the neural net calculation. Figure 12 
shows the standard form of the feedforward NN using sigmoid node functions to solve a 
multiple input single output system (MIMO). Based on this architecture, the formula for 
W g obtained from the neural net calculation may be expressed as: 



10 W g (z) = r 



15 



p ( 



i=i 



WGT SENSITIVITY 2 



where z is the vector of inputs, p is the number of neurons in the hidden layer, m is the 
number of inputs, Wljj is the weight of the j th input to the 1 th neuron in the hidden layer, 
blj is the bias added to the i th neuron, W2; is the weight of the i th neuron to the output 
neuron, b2 is the bias added to the output neuron, and / is the tanh function. 



20 



If a feedforward neural net with one hidden layer containing p sigmoidal neurons 
is assumed, the functional form is known and can be differentiated and expressed as: 



WGT SENSITIVITY 3 8W g (z)/5z k = 



P I m 

1=1 



7=1 



f-1 \ 7=1 
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where f is cosh A (-2) of the same argument. 



Sensitivity with respect to z k can be expressed as: [5/(z)/5z k ], evaluated at the 
desired place(s) in the parameter space, and a relative sensitivity by dividing through by 
5 the sum of the absolute values of the derivatives. 

In an embodiment in which the inputs are scaled to approximately a -1 to +1 
range for input to the neural net, the value for W g output may also be a value similarly 
scaled. It should be noted that the foregoing expresses terms of scaled W g to scaled 
1 0 inputs. It may be preferable to examine unsealed W g to unsealed inputs using the 
following: 

desired_sens(k) = calc_sens(k)*factor(k)/factor(6) WGT SENSITIVITY 4 

15 where factor(k) is the scale factor for the kth input and factor(6) is the weight scale 
factor. 

Based on the foregoing, the inventors determined that the calculation of W g is 
most sensitive to Q, the engine torque(s) with the relative sensitivity to Q about 99% 
20 everywhere in the parameter space covered by the input data of test results. The 

remainder of the sensitivity is about equal for the other variables. The sensitivity with 
respect to the other parameters may vary in accordance with what portion of a parameter 
space is evaluated for a given parameter. 
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The inventors evaluated results of the 5 neural nets for the forward flight regime 
using the parameters and other particulars as described herein. Based on this, the results 
of the neural nets produced a distribution of testing error as shown in the histogram 1200 
of Figure 30. It should first be noted that the results of all the nets trained for a given 
regime are quite close to each other. For example, in the test run where the best net gave 
a RMS testing error of 548.8 lbs., the worst gave a RMS testing error of 549.6 lbs. 

Referring to the histogram 1200, the distribution of testing error may be 
characterized as Gaussian. In this particular example, there is a mean of -6.7 lbs. and a 
standard deviation of 549 lbs. 

It may also be desirable to estimate the error in inferred gross weight due to error 
in the inputs. The relative error in W g may be expressed as: 

(A W g I W s T2 = Z [(d W g / 8z k )(Az* / z k )]-2 

where Zk is the k th input, the sum is taken over all the inputs, and the partials are the same 
as those derived in the sensitivity section. 

In connection with results and data used by the inventors such that values for 
weights and biases from the best NN approximation to W g for the forward flight regime 

A A 

are used with a 1 % uncertainty in each of the input parameters, a value for (A W g l W g ) 
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of about 1 .5 %, or about 300 lbs. on a 20,000 lbs. machine, is obtained. It should be 
noted that this evaluation may be dependent on where a point is in the parameter space. 

An embodiment may combine the foregoing relative error value, associated with 
5 error introduced by the neural nets, with an RMS error value associated with the use of 
mass interpolation to obtain an expected RMS error. 

In connection with the use of neural nets, a large amount of empirical data may be 
required covering every regime during which the net must supply a reliable estimate. 

10 Such data may not be readily available, for example, such as in connection with new 
aircraft development, as well as difficulties in obtaining actual data for different flight 
regimes. In such cases, an embodiment may include an alternate technique to use in 
place of a neural net, or to augment any weight estimate value produced as a neural net 
output. An embodiment may use a Kalman filter in either of the foregoing configurations 

15 as well as other described herein. 

Use of a Kalman filter in connection with determining a gross weight estimate for 
the aircraft such as a helicopter will now be described. Use of a Kalman filter can be 
used in a gross weight calculation by casting the system into a state / measurement 
20 formulation. Let a recursive relationship for gross weight at successive time values be 
represented by: 



x k = <p k _ x x k _ x + w k _ x KALMAN EQTN 1 
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10 



where the k? h value of x (xr ) is related to the k th -l value through the transformation matrix 
(p. Also note the system is affected by process noise, w, which in general has covariance 
Q 

For the problem of gross weight calculation, the system states (x) may be defined 

as: 



KALMAN EQTN 2 



where W % is the gross weight and wf x is the fuel flow rate for each of engine. The 
superscript denotes the transpose operation. 



15 



The transformation matrix, <p, may be given by: 



<p = 



f\ -At -Ar> 

0 1 0 
10 0 1 j 



KALMAN EQTN 3 



An optimal estimate of x can be developed using a state estimation technique such as a 
Kalman filter. Kalman filter are well known as described, for example in Gelb, Arthur, 
20 Applied Optimal Estimation, MIT Press, 1974. 
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In this formulation, the measurement equation for the system is specified to have 
the form: 

z k =H k x +v* KALMAN EQTN 4 

5 

where z represents the system measurements: 

z = {Wh w/\ w/if KALMAN EQTN 5 

1 0 In this formulation, standard vehicle performance information can be used to 

augment the measurements. For example, hover performance calculations may be used 
as an additional source of gross weight information. Hover gross weight (Wh) 
calculations, such as those found in vehicle flight and performance data, relate gross 
weight at hover to altitude (h), Outside Air Temperature (OAT), and engine torque (Q) 

1 5 and may be expressed as: 

W H =XQ 5 h, OAT) KALMAN EQTN 6 

The resulting measurement vector z with m weight related measurements may be 
20 represented as: 

z = (tVs w/\ w/2 Wh) t KALMAN EQTN 7 
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where: 

Wh is the 'pseudo-measurement' of gross weight calculated at hover conditions; 
wfl and wf2 are fuel flow measurements (or pseudo-measurements); and 
Ws is gross weight totalized from various sources, including fuel quantity 
measures, equipment weights, aircraft empty weight, and the like. In an 
embodiment, weights such as the empty aircraft weight, crew member weights, 
and the like may be manually entered or read from a data store, such as non- 
volatile computer memory. The empty aircraft weight varies in accordance with 
the type of aircraft and may be obtained from an aircraft log book. Similarly, 
other weights, such as related to equipment on-board, may also be obtained and 
entered into the system. 

The system has n states (x) which contains that information required to define the 
differential equation for gross weight (W). Since the gross weight computed as the sum 
1 5 of weights (Ws) may be in error, such as, for example, due to human error or other 

factors also described elsewhere herein, the system states may be augmented to include a 
bias term, bw: 

x = (w w/\ wfi bw) T KALMAN EQTN 8 

20 

The corresponding transition matrix (<p ) (of size nxn) which relates the states at a future 
time to the current states is given by: 
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(\ -At -At 0^ 

0 1 0 0 

0 0 10 

0 0 0 1 



KALMAN EQTN 9 



H represents the m x n measurement transformation matrix. It relates the measurements 
to the states given by: 



H = 



noon 

0 10 0 
0 0 10 
[\ 0 0 0) 



KALMAN EQTN 10 



The measurements are also affected by a random measurement error v, which is assumed 
to have covariance R, which is an m x m diagonal matrix. Q, the process noise, is an n x 

10 n diagonal matrix. Note that the elements of Q and R do not need to be constant. For 

example, since the 'pseudo-measurement' of Wh is only accurate at hover, the element of 
R associated with Wh may be varied as the vehicle maneuvers from hover to non-hover 
flight conditions. As confidence in the measurement decreases, the measurement's 
corresponding element in R increases. The matrix Q confidence corresponds to the 

1 5 confidence in the mathematical model as represented by the state equations of the 
Kalman filter. For the element of Q, it should be noted that as the confidence in the 
mathematical state equation model decreases, a corresponding element in Q increases. 



An embodiment may use a function to vary the element of R associated with Wh: 
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R 

W H = g(a x , a z , O, 0, V, h) KALMAN EQTN 1 1 

where a x and a z are body accelerations along the x and z axis respectively, <D is roll 
attitude, 0 is pitch attitude, V is airspeed, and h is altitude. 

5 

The Kalman filter process may then be formulated as: 
Filter Initialization 

p;=o 
io x;=x(t = o) 

k = \ 
where 

Po + represents the initial error covariance matrix and x o + is the initial state vector; 
use of the " A " symbol represents that the associated quantity, such as x is denoted 
above, is an estimate; and 
15 k is a time step. 

During filter initialization, the previous values of the state vector estimate and the error 
covariance matrix are being set. The use "-" as a superscript denotes a value of a quantity 
prior to the filter update. The use of "+" as a superscript denotes a value of a quantity 
20 after a filter update. The Kalman filter generates initial values (the "-" values) and then 
applies corrections to them as part of the filtering process (the "+" values). The Kalman 
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filter propagates the state one step forward at a time, calculates the Kalman gain (which 
combines the measurement and process noise covariance elements together), compares 
predicted and actual measurements, and uses the error between the predicted and 
measured values with the gain to modify the state estimate producing an updated state 
5 estimate. 

State Estimate Extrapolation 

X k = <Pk-\ X k-\ 

1 0 Error Covariance Extrapolation 

Kalman Gain Matrix 

K k = P k H I[ H k P k H k + ^J" 1 
1 5 where K k is the Kalman gain computed at a time step k. 

State Estimate Update 

x l = *k + K A z k ~ H k x l] 

It should be noted that the value &l is the resulting updated state matrix from KALMAN 

EQTN 8 above which contains the optimal estimates of vehicle gross weight, fuel flow 
20 rate, and the weight bias estimate. 
Error Covariance Update 
P;=[I-K k H k ]P k - 
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At the end of one iteration of processing in connection with the Kalman filter, the 
system states, as represented by KALMAN EQTN 8 above, are recomputed. The filter is 
re-run as new data is available at the next time step. 

5 

What will now be described is additional detail on the measurement noise 
covariance matrix R. 

In the foregoing example, the 'pseudo-measurement' of W H is only accurate at 
1 0 hover. Its corresponding element of the measurement noise covariance matrix, R, varies 
as there is more or less confidence in the fact that the aircraft is in a hover state at any 
particular time. It is known that an exact state of hovering may not be known since the 
parameters used to characterize hovering behavior (e.g., airspeed, altitude, accelerations, 
attitude angles) are not exactly known. For example, the airspeed measurement of a 
1 5 hovering vehicle may be characterized as typically very inaccurate. 

The element of the measurement noise covariance matrix R associated with the 
hover gross weight measurement may be represented by a function B. 

R 

20 W H = B(a x ,a z ,O,0,V,h) 



The specific form of B included in an embodiment may be determined from 
consideration of vehicle flight mechanics. 
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When a vehicle of mass m hovers, the weight vector is directly balanced by the 
propulsive forces. No additional dynamic forces are applied. For such cases, the 
longitudinal propulsive force is balanced by the component of weight in the longitudinal 
5 axis. Likewise, the vertical propulsive force is balanced by the vertical component of 
weight and each component, a, may be represented as: 

a x m = m G sin(9) EQTN R 1 

10 a z m = m G ( 1 + cos(9) sin(<|>)) EQTN R2 

where G is the acceleration due to gravity. At hover, the forces balance out and EQTNS 
Rl and R2 above may be rewritten, respectively as EQTNS Rl A and R2A: 

15 a x - G sin(9) = 0 EQTN Rl A 

a z - G - cos(0) sin(<}>)= 0 EQTN R2A 

At hover, the product of EQTNS Rl A and R2A: 

20 

| (a x - G sin(0)) (a z - G - cos(8) sin(4>)) I = 0 EQTN R3 
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If a condition is detected near the foregoing, there is a high probability that the aircraft is 
in the hovering regime. Note that the vehicle speed must be zero to ignore the dynamic 
forces. Since the speed measurement may be characterized as inaccurate, an embodiment 
may use a function for determining values of B. Based on normal vehicle operations, it 
5 may be stated that the vehicle only hovers if the altitude is between h m i n and h max feet, and 
the airspeed is less than Vi ow . 

It should be noted that input values to the function B, such as altitude, speed, and 
the like, may have an amount of extraneous noise or interference causing the calculated 
output value of the function B to also be characterized as "noisy". Once a value for B is 
determined, an embodiment may use one or more smoothing techniques to take into 
account unwanted noise that may be introduced through the input values to the function 
B. Smoothing techniques, such as first order lag functions, are known to those of 
ordinary skill in the art and may be used to reduce the unwanted interference. 
Below is a definition of a blending function for Rwh that may be used to augment initial 
values for Rwh- 

The function, B, for determining Rwh that may be included in an embodiment is 
represented as: 
20 

At time = 0: 

R WH (0) = kl; 
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B(0) = k2; 
B s (0) = k2; 

wherein B and B s represent the values for the hover weight measurement noise, Bs being 
the smoothed value generated using the first order lag filter. 

5 

For time = i (i > 0): 

Rwh (i) = (k3*RwH (i-1) + k4) / (l+k3); 

if B s (i-1) < k5 then Rwh (i) = (k3*RwH (i-1) + k6) / (l+k3); 

B(i) = k2; 

10 

if h > h min & h < h max & V < V min /* If hover conditions exist */ 

B(i) = | (a x - G sin(0)) (a z - G - cos(9) sin(4>))) | 
B s (i) = ( k7 g s (i-l) + k8 g(i) ) / (k7 + k8) 

1 5 The foregoing function B may be characterized as continuous function producing 

a peak and valley as specific predetermined values for a given flight regime. As 
described elsewhere herein, the function B represents the level of confidence in the value 
associated with the value, the weight pseudo-measurement, in the hover regime. 
Although the foregoing function B is for use with the hover weight measurement Rwh, 

20 other functions may be determined for use with other regimes and other values of R 
varying inversely with the level of confidence in the particular value at a point in time. 
For example, an embodiment may include as an input to the Kalman filter the neural 
network estimated weight in the hover regime. In determining the neural net estimate 
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weight's corresponding element in the R matrix, RMS error or standard deviation 
information may be obtained as determined from the neural network training. As the 
confidence in the neural network estimated weight for the hover regime decreases, its 
corresponding element in the R matrix should increase. 

5 

The constants kl - k8 are determined by trial and error such that the estimated 
and actual gross weight track correctly and have a reasonable dynamic response. Their 
values are all positive and non-zero. If properly defined, the value of Rwh should 
increase as Bs increases and the level of confidence in the corresponding W H 
1 0 measurement value decreases, (e.g., as the value of the smoothed blending function 

increases, confidence decreases that the aircraft is in a hover condition). Likewise, R W h 
should decrease as Bs decreases. 



The foregoing definition for R W h may be used in an embodiment in connection 
1 5 with a weight value in the hover regime. Other values of R may be determined and used 
in other regimes and/or for other values. 



In connection with the Q and R matrices, Q may be characterized as process noise 
or model error. Q values may be determined empirically using known data from previous 
20 runs as well as on a trial and error. Q may be tuned or selected for each filter for each 
particular application. R may be characterized as representing the model noise used to 
blend out or appropriately weight corresponding measurements. The matrix R is 
recomputed each frame. W H may be determined for each frame based on other values 
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related to one another as defined, for example, in a flight manual. The fuel flow inputs 
wfl and wf2 may be measured directly or indirectly in an embodiment. The bias weight 
term, bw, in the foregoing is determined by the Kalman filter processing steps. In 
summary, for each new set of inputs to the Kalman filter, the following are updated: 
5 all elements of the measurement vector z, elements of the vector x (including the bias), 
some entries of the transition matrix involving the difference in time elements (in the 
event that the time steps are not constant), selection of a particular R function based on 
regime, updating of terms/variables of the selected R function, the Kalman gain, the 
updated state vector, and the filter error covariance matrix. 

10 

Using the foregoing, a recursive filter scheme can be utilized in which the initial 
state estimates are blended with the measurements using known physical relationships, 
such as fuel depletion and hover performance. In one embodiment, a discrete, linear 
Kalman filter may be used. 

15 

The inventors used flight data from a twin-engine helicopter to evaluate the 
performance of the Kalman filter for estimating vehicle gross weight. A series of runs 
were performed for various flight operations and for a series of simulated weight errors. 
In the flight data, fuel flow rate was not directly measurable. Engine performance data 
20 was used to develop a model of fuel flow rate as a function of engine torque, altitude, and 
outside air temperature. In addition, the helicopter airdata transducer only gave an 
airspeed measurement down to 30 kts. As airspeed is used to set the element of R 
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associated with the hover gross weight measurement error, the associated calculation had 
to account for the rather broad range of airspeed between 0 and 30 kts. 



As illustrated in Figures 31 and 32 based on results obtained by the inventors, the 
5 Kalman filter is able to estimate the weight bias within 44 lbs. for a 600 lb. weight offset 
error, and 32 lbs. for a -1200 lb. weight offset error. Note that in these two illustrations 
of Figures 31 and 32, the performance of the Kalman filter is represented by the 
ESTIMATED curve. These results may be characterized as illustrating favorable 
performance of the Kalman filter in determining aircraft gross weight given the lack of 
1 0 fuel flow rate and low airspeed information in the particular runs performed by the 

inventors. Note that the filter would not provide any improvement in the foregoing gross 
weight estimation if there were no hover maneuvers during the flight. 



An embodiment may use one aspect of the Kalman filter formulation in 
15 determination of a lower bound for the state estimates. The well-known Cramer Rao 

lower bound may be determined from the system Fisher Information matrix, as described, 
for example, in T. M. Cover and J. A. Thomas, Elements of Information Theory, John 
Wiley & Sons, Inc, 1991; L. L. Scharf, Statistical Signal Processing, Addison- Wesley, 
1991 and B. Noble and J. W. Daniel, Applied Linear Algebra, Prentice-Hall, 1988. 
20 As is also well-known, the Fisher Information matrix is a measure of the information 

content of the measured signal relative to a particular parameter. The Cramer-Rao bound 
is a lower bound on the error variance of the best estimator for the given system. The 
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Cramer Rao bounds can be determined and used to assess the quality of the gross weight 
estimates, such as in connection with the weight bias, bw. 

In an embodiment utilizing both the neural net(s) and the Kalman filter, as 
5 described in connection with Figure 1 1 for example, the neural net output may be used as 
a 'pseudo-measurement' in the filter's measurement vector, z. The corresponding 
element of the measurement covariance matrix, R, may then be updated to reflect the 
relative accuracy of the neural net output. Additionally, use of a corresponding value in 
the R matrix for a particular pseudo-measurement may be used as a weighting or 

1 0 confidence factor to use a pseudo-measurement from one regime to be used in 

determining the weight for a second different regime. Use of the Kalman filter in an 
embodiment not only allows for the estimate to be propagated into regime space 
unknown by the neural net, but the use of Cramer-Rao lower bounds calculation provides 
a continual measure of confidence. This confidence information may be used as a 

1 5 qualifier, forcing the structural usage calculations to assign worst case damage when 

confidence falls below predetermined limits. The stochastic nature of the Kalman filter 
enables calculation of the Cramer-Rao lower bounds. 

It should be noted that an embodiment may use the same set of aircraft sensor 
20 data in connection with the neural net formulation and the Kalman filter formulation. 

The foregoing describes techniques used to determine gross weight using sensed 
data. A neural net may use empirical relationships existing in the data to make a gross 
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weight determination. A recursive state filter, the Kalman filter, may also be used 
separately, or in combination with, the neural net(s) in making a gross weight 
determination. In one embodiment described herein, the Kalman filter may be used to 
blend the neural net gross weight determination with other inputs to make final gross 
5 weight determination. 

Referring now to Figure 33, shown is a flowchart of processing steps that may be 
performed in an embodiment to estimate the gross weight of an aircraft. The processing 
steps of flowchart 1400 summarizes the steps of one embodiment in which the Kalman 
1 0 filter and the neural net techniques as described herein are included. Additionally, the 
flowchart 1400 uses an output of the neural net, a first gross weight estimate, as an input 
to the Kalman filter in determining a final gross weight estimate, such as output 512 
included in Figure 1 1 . 

15 At step 1402, one or more neural nets are trained and selected for inclusion in the 

gross weight estimator 510.. It should be noted that step 1402 may be performed offline 
prior to execution of the gross weight estimator, such as during online flight operation of 
the aircraft. The remaining steps of flowchart 1400 may be performed when the gross 
weight estimator is running online in determining the gross weight of the helicopter or 

20 other aircraft. At step 1404, a set of sensor measurements and other inputs are obtained. 
At step 1406, the flight regime is determined based on sensor measurements and the other 
inputs. At step 1408, one or more neural net inputs are determined based on the flight 
regime determined at step 1406. At step 1410, one or more neural nets are selected based 
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on the flight regime. At step 1412, the neural net(s) generate output(s) providing a first 
estimate of the gross weight. At step 1414, the Kalman filter measurements are 
determined including the first gross weight estimate. At step 1416, the appropriate R 
fiinction(s) are selected for the first gross weight, and possibly other weight estimates, 
5 based on the flight regime. At step 1418, the final gross weight estimate is determined 
using the Kalman filter. At step 1420, the Kalman filter state values are updated for the 
next iteration using the next set of inputs. At step 1422, a determination is made as to 
whether processing is complete. In this embodiment, the gross weight estimator may keep 
running as long as the unit is enabled for processing. If processing is complete, 
10 processing stops. Otherwise, control proceeds to step 1404 to obtain the next set of data. 

It should be noted that the processing steps of flowchart 1400 are an example 
steps that may be performed in one embodiment of the gross weight estimator using both 
neural nets and a Kalman filter. Other embodiments may include and/or utilize just one 
15 of the foregoing components. An embodiment may also use other inputs to the Kalman 
filter than as described herein and other variations of the neural net, parameters, and the 
like than as described herein. The specific examples and illustrations should not be 
construed as a limitation of the techniques described herein. 

20 It should be noted that the foregoing techniques used for gross weight estimation 

may be used as a cross-checking of other gross weight data or as a replacement for other 
gross weight data. Although the foregoing embodiments illustrate the use of techniques 
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with neural networks and/or Kalman filters for determining aircraft weight, techniques • 
described herein may be used in connection with determining other aircraft parameters. 



While the invention has been disclosed in connection with various embodiments, 
5 modifications thereon will be readily apparent to those skilled in the art. Accordingly, 
the spirit and scope of the invention is set forth in the following claims. 
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